Apr 16 22:51:17 devstack cinder-volume[72096]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 16 22:51:17 devstack cinder-volume[72096]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 22:51:17 devstack cinder-volume[72096]: we strongly recommend against using it for new projects. Apr 16 22:51:17 devstack cinder-volume[72096]: If you are already using Eventlet, we recommend migrating to a different Apr 16 22:51:17 devstack cinder-volume[72096]: framework. For more detail see Apr 16 22:51:17 devstack cinder-volume[72096]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 22:51:17 devstack cinder-volume[72096]: import eventlet # noqa Apr 16 22:51:19 devstack cinder-volume[72096]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72096) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 22:51:19 devstack cinder-volume[72096]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72096) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 22:51:19 devstack cinder-volume[72096]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72096) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 22:51:20 devstack cinder-volume[72096]: INFO dbcounter [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Registered counter for database cinder Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_db.sqlalchemy.engines [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72096) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG dbcounter [-] [72096] Writer thread running {{(pid=72096) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 22:51:20 devstack cinder-volume[72096]: INFO cinder.rpc [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 16 22:51:20 devstack cinder-volume[72096]: INFO cinder.rpc [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_db.sqlalchemy.engines [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72096) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:51:20 devstack cinder-volume[72096]: INFO cinder.volume.manager [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Determined volume DB was empty at startup. Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG cinder.volume.manager [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72096) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 16 22:51:20 devstack cinder-volume[72096]: INFO cinder.volume.manager [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 16 22:51:20 devstack cinder-volume[72096]: WARNING stevedore.named [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 22:51:20 devstack cinder-volume[72096]: WARNING castellan.key_manager [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 22:51:20 devstack cinder-volume[72096]: WARNING cinder.keymgr.conf_key_mgr [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG cinder.volume.drivers.lvm [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72096) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_concurrency.processutils [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_concurrency.processutils [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] CMD "cinder-rtstool verify" returned: 0 in 0.265s {{(pid=72096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_db.sqlalchemy.engines [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72096) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:51:20 devstack cinder-volume[72096]: INFO cinder.rpc [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 16 22:51:20 devstack cinder-volume[72096]: INFO cinder.rpc [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 16 22:51:20 devstack cinder-volume[72096]: WARNING stevedore.named [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 22:51:20 devstack cinder-volume[72096]: WARNING castellan.key_manager [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 22:51:20 devstack cinder-volume[72096]: INFO cinder.volume.manager [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_db.sqlalchemy.engines [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72096) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:51:20 devstack cinder-volume[72096]: INFO oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Starting 1 workers Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Started child 72199 {{(pid=72096) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Full set of CONF: {{(pid=72096) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] ******************************************************************************** {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Configuration options gathered from: {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 16 22:51:20 devstack cinder-volume[72199]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] ================================================================================ {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] allow_availability_zone_fallback = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] allow_compression_on_image_upload = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] allowed_direct_url_schemes = [] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] api_rate_limit = True {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] auth_strategy = keystone {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] az_cache_duration = 3600 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_availability_zone = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_host = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_name = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_stats_polling_interval = 60 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backup_api_class = cinder.backup.api.API {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backup_name_template = backup-%s {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backup_use_same_host = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backup_use_temp_snapshot = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] chap_password = **** {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] chap_username = {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cinder_internal_tenant_project_id = 376e1c3a4a4c4766a9a72421cca32d62 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cinder_internal_tenant_user_id = c275d7f8c72947c0a82411eda7ea0c48 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cloned_volume_same_az = True {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cluster = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] compression_format = gzip {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] compute_api_class = cinder.compute.nova.API {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] config_dir = [] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] config_source = [] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] control_exchange = openstack {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] debug = True {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] default_availability_zone = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] default_group_type = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] default_volume_type = lvmdriver-1 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] disk_geometry = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] driver_client_cert = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] driver_client_cert_key = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] driver_data_namespace = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] driver_ssl_cert_path = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] driver_ssl_cert_verify = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] driver_use_ssl = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] enable_force_upload = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] enable_new_services = True {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] enable_unsupported_driver = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] enforce_multipath_for_image_xfer = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] filter_function = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] glance_api_insecure = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] glance_api_servers = ['http://192.168.122.38/image'] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] glance_api_ssl_compression = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] glance_ca_certificates_file = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] glance_catalog_info = image:glance:publicURL {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] glance_certfile = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] glance_keyfile = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] glance_num_retries = 3 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] glance_request_timeout = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] goodness_function = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] graceful_shutdown_timeout = 5 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] group_api_class = cinder.group.api.API {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] host = devstack {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] image_compress_on_upload = True {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] image_conversion_address_space_limit = 1 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] image_conversion_cpu_limit = 60 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72199]: INFO cinder.volume.manager [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] image_conversion_disable = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] image_upload_use_cinder_backend = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] image_upload_use_internal_tenant = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] image_volume_cache_enabled = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] image_volume_cache_max_count = 0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] image_volume_cache_max_size_gb = 0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] init_host_max_objects_retrieval = 0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] instance_format = [instance: %(uuid)s] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] iscsi_target_flags = {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] iscsi_write_cache = on {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] iser_helper = tgtadm {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] iser_ip_address = 192.168.122.38 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] iser_port = 3260 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] log_color = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] log_config_append = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] log_dir = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] log_file = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] log_options = True {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] log_rotate_interval = 1 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] log_rotate_interval_type = days {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] log_rotation_type = none {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] max_age = 0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] max_logfile_count = 30 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] max_logfile_size_mb = 200 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] max_over_subscription_ratio = 20.0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] message_reap_interval = 86400 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] message_ttl = 2592000 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] migration_create_volume_timeout_secs = 300 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] monkey_patch = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] monkey_patch_modules = [] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] my_ip = 192.168.122.38 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] no_snapshot_gb_quota = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] num_iser_scan_tries = 3 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] num_shell_tries = 3 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] num_volume_device_scan_tries = 3 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] nvmeof_conn_info_version = 1 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] nvmet_ns_id = 10 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] nvmet_port_id = 1 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] osapi_max_limit = 1000 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] osapi_volume_ext_list = [] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] osapi_volume_listen_port = 8776 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] osapi_volume_use_ssl = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] osapi_volume_workers = 2 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] per_volume_size_limit = -1 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] periodic_fuzzy_delay = 60 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] periodic_interval = 60 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] public_endpoint = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] publish_errors = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] quota_backup_gigabytes = 1000 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] quota_backups = 10 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] quota_gigabytes = 1000 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] quota_groups = 10 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] quota_snapshots = 10 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] quota_volumes = 10 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] rate_limit_burst = 0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] rate_limit_except_level = CRITICAL {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] rate_limit_interval = 0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] reinit_driver_count = 3 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] replication_device = **** {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] report_discard_supported = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] report_interval = 120 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] reservation_clean_interval = 86400 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] reservation_expire = 86400 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] reserved_image_namespaces = [] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] reserved_percentage = 0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] rpc_response_timeout = 120 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] run_external_periodic_tasks = True {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] scst_target_driver = iscsi {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] scst_target_iqn_name = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] service_down_time = 720 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] shell_completion = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] snapshot_name_template = snapshot-%s {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] snapshot_same_host = True {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] split_loggers = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] state_path = /opt/stack/data/cinder {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] storage_availability_zone = nova {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] storage_protocol = iSCSI {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] syslog_log_facility = LOG_USER {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] target_helper = lioadm {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] target_ip_address = 192.168.122.38 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] target_port = 3260 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] target_protocol = iscsi {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] target_secondary_ip_addresses = [] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] trace_flags = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] transport_url = **** {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] until_refresh = 0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] use_chap_auth = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] use_default_quota_class = True {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] use_journal = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] use_json = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] use_multipath_for_image_xfer = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] use_stderr = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] use_syslog = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] verify_glance_signatures = enabled {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] volume_api_class = cinder.volume.api.API {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] volume_backend_name = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] volume_clear = zero {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] volume_clear_ionice = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] volume_clear_size = 0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] volume_copy_bps_limit = 0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] volume_dd_blocksize = 1M {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] volume_name_template = volume-%s {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] volume_service_inithost_offload = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] volume_usage_audit_period = month {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] zoning_mode = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_concurrency.disable_process_locking = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.admin_password = **** {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.admin_token = **** {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.admin_user = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.auth_port = 35357 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.auth_protocol = https {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.auth_section = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:20 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.auth_type = password {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.auth_uri = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.auth_version = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.cache = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.certfile = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.identity_uri = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.include_service_catalog = True {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.insecure = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.interface = public {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.keyfile = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.memcache_password = {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.memcache_username = {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.region_name = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.service_type = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.38/identity {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.backend = dogpile.cache.null {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.backend_argument = **** {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.backend_expiration_time = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.config_prefix = cache.oslo {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.debug_cache_backend = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.enable_retry_client = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.enable_socket_keepalive = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.enabled = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.enforce_fips_mode = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.expiration_time = 600 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.hashclient_retry_attempts = 2 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.memcache_dead_retry = 300 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:20 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.memcache_pool_maxsize = 10 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.memcache_sasl_enabled = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.password = **** {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.proxies = [] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.redis_db = 0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.redis_server = localhost:6379 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.retry_attempts = 2 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.retry_delay = 0.0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.socket_keepalive_count = 1 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.socket_keepalive_idle = 1 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.socket_keepalive_interval = 1 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.socket_timeout = 1.0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.tls_allowed_ciphers = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.tls_cafile = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.tls_certfile = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.tls_enabled = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.tls_keyfile = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cache.username = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] coordination.backend_url = **** {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] database.asyncio_connection = **** {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] database.asyncio_slave_connection = **** {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] database.backend = sqlalchemy {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] database.connection = **** {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] database.connection_debug = 0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] database.connection_parameters = {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] database.connection_recycle_time = 3600 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] database.connection_trace = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] database.db_inc_retry_interval = True {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] database.db_max_retries = 20 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] database.db_max_retry_interval = 10 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] database.db_retry_interval = 1 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] database.max_overflow = 50 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] database.max_pool_size = 5 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] database.max_retries = 10 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] database.mysql_wsrep_sync_wait = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] database.pool_timeout = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] database.retry_interval = 10 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] database.slave_connection = **** {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] database.sqlite_synchronous = True {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] database.synchronous_reader = True {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] database.use_db_reconnect = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] profiler.connection_string = messaging:// {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] profiler.enabled = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] profiler.es_doc_type = notification {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] profiler.es_scroll_size = 10000 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] profiler.es_scroll_time = 2m {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] profiler.filter_error_trace = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] profiler.hmac_keys = **** {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] profiler.sentinel_service_name = mymaster {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] profiler.socket_timeout = 0.1 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] profiler.trace_requests = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] profiler.trace_sqlalchemy = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] profiler_jaeger.process_tags = {} {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] profiler_jaeger.service_name_prefix = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] profiler_otlp.service_name_prefix = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack sudo[72203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_policy.enforce_new_defaults = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack sudo[72203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:51:20 devstack cinder-volume[72096]: WARNING oslo_config.cfg [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_policy.enforce_scope = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_policy.policy_default_rule = default {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_policy.policy_file = policy.yaml {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] privsep_osbrick.group = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] privsep_osbrick.helper_command = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] privsep_osbrick.user = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cinder_sys_admin.group = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cinder_sys_admin.helper_command = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] cinder_sys_admin.user = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] service_user.auth_section = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] service_user.auth_type = password {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] service_user.cafile = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] service_user.certfile = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] service_user.collect_timing = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] service_user.insecure = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] service_user.keyfile = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] service_user.send_service_user_token = True {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] service_user.split_loggers = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] service_user.timeout = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] glance.auth_section = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] glance.auth_type = password {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] glance.certfile = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] glance.collect_timing = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] glance.insecure = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] glance.keyfile = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] glance.region_name = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] glance.split_loggers = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] glance.timeout = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.backend_availability_zone = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.chap_password = **** {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.chap_username = {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.disk_geometry = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.driver_client_cert = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.driver_client_cert_key = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.driver_data_namespace = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.driver_use_ssl = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.extra_capabilities = {} {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.filter_function = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.goodness_function = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.iscsi_target_flags = {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.iscsi_write_cache = on {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.iser_helper = tgtadm {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.iser_ip_address = 192.168.122.38 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.iser_port = 3260 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.lvm_share_target = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.lvm_type = auto {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.num_shell_tries = 3 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.replication_device = **** {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.report_discard_supported = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.reserved_percentage = 0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.target_helper = tgtadm {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.target_ip_address = 192.168.122.38 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.target_port = 3260 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.target_protocol = iscsi {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.trace_flags = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.unique_fqdn_network = True {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.use_chap_auth = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.volume_backend_name = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.volume_clear = zero {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.volume_clear_ionice = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.volume_clear_size = 0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_reports.file_event_handler = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_reports.log_dir = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.backend_host = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.chap_password = **** {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.chap_username = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.disk_geometry = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.driver_client_cert = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.extra_capabilities = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.filter_function = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.goodness_function = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.iser_helper = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.iser_ip_address = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.iser_port = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.lvm_share_target = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.lvm_type = auto {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.num_shell_tries = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.replication_device = **** {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.report_discard_supported = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.reserved_percentage = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.scst_target_driver = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.storage_protocol = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.target_helper = lioadm {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.target_ip_address = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.target_port = 3260 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.trace_flags = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.use_chap_auth = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.volume_clear = zero {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.volume_clear_size = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] lvmdriver-1.volumes_dir = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.ssl = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_notifications.driver = [] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_notifications.retry = -1 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] key_manager.fixed_key = **** {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican.barbican_api_version = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican.barbican_endpoint = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican.barbican_endpoint_type = public {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican.barbican_region_name = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican.cafile = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican.certfile = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican.collect_timing = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican.insecure = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican.keyfile = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican.number_of_retries = 60 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican.retry_delay = 1 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican.send_service_user_token = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican.split_loggers = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican.timeout = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican.verify_ssl = True {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican.verify_ssl_path = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican_service_user.auth_section = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican_service_user.auth_type = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican_service_user.cafile = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican_service_user.certfile = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican_service_user.collect_timing = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican_service_user.insecure = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican_service_user.keyfile = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican_service_user.split_loggers = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] barbican_service_user.timeout = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] vault.approle_role_id = **** {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] vault.approle_secret_id = **** {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] vault.kv_mountpoint = secret {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] vault.kv_path = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] vault.kv_version = 2 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] vault.namespace = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] vault.root_token_id = **** {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] vault.ssl_ca_crt_file = None {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] vault.timeout = 60.0 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] vault.use_ssl = False {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:51:20 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] ******************************************************************************** {{(pid=72096) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 16 22:51:21 devstack sudo[72203]: pam_unix(sudo:session): session closed for user root Apr 16 22:51:21 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.605s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:21 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:21 devstack sudo[72209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 22:51:21 devstack sudo[72209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:51:22 devstack sudo[72209]: pam_unix(sudo:session): session closed for user root Apr 16 22:51:22 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.620s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:22 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:51:22 devstack cinder-volume[72199]: INFO cinder.brick.local_dev.lvm [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 16 22:51:22 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:22 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:22 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:22 devstack sudo[72485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 22:51:22 devstack sudo[72485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:51:22 devstack sudo[72485]: pam_unix(sudo:session): session closed for user root Apr 16 22:51:22 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.475s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:22 devstack cinder-volume[72199]: DEBUG cinder.brick.local_dev.lvm [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72199) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 16 22:51:22 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:22 devstack sudo[72696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 22:51:22 devstack sudo[72696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:51:23 devstack sudo[72696]: pam_unix(sudo:session): session closed for user root Apr 16 22:51:23 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.021s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:23 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:23 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:23 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:23 devstack sudo[72892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 22:51:23 devstack sudo[72892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:51:24 devstack sudo[72892]: pam_unix(sudo:session): session closed for user root Apr 16 22:51:24 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.467s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:24 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:24 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:24 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:24 devstack sudo[72899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 16 22:51:24 devstack sudo[72899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:51:24 devstack sudo[72899]: pam_unix(sudo:session): session closed for user root Apr 16 22:51:24 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.441s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:24 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:24 devstack sudo[72902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 22:51:24 devstack sudo[72902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:51:24 devstack sudo[72902]: pam_unix(sudo:session): session closed for user root Apr 16 22:51:24 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.471s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:24 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:25 devstack sudo[72907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 22:51:25 devstack sudo[72907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:51:25 devstack sudo[72907]: pam_unix(sudo:session): session closed for user root Apr 16 22:51:25 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.492s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:25 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:25 devstack sudo[72910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 22:51:25 devstack sudo[72910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:51:25 devstack sudo[72910]: pam_unix(sudo:session): session closed for user root Apr 16 22:51:25 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.505s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:25 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:26 devstack sudo[72918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 22:51:26 devstack sudo[72918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:51:26 devstack sudo[72918]: pam_unix(sudo:session): session closed for user root Apr 16 22:51:26 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.446s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:26 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:26 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:26 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:26 devstack sudo[72922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 22:51:26 devstack sudo[72922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:51:26 devstack sudo[72922]: pam_unix(sudo:session): session closed for user root Apr 16 22:51:26 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.465s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:26 devstack cinder-volume[72199]: INFO cinder.volume.drivers.lvm [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 16 22:51:26 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:26 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:26 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:26 devstack sudo[72932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 22:51:26 devstack sudo[72932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:51:27 devstack sudo[72932]: pam_unix(sudo:session): session closed for user root Apr 16 22:51:27 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.510s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:27 devstack cinder-volume[72199]: DEBUG cinder.volume.drivers.lvm [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Updating volume stats {{(pid=72199) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 22:51:27 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:27 devstack sudo[73045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 22:51:27 devstack sudo[73045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:51:27 devstack sudo[73045]: pam_unix(sudo:session): session closed for user root Apr 16 22:51:27 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.469s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:27 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:27 devstack sudo[73176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 22:51:27 devstack sudo[73176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:51:28 devstack sudo[73176]: pam_unix(sudo:session): session closed for user root Apr 16 22:51:28 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:28 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:28 devstack sudo[73189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 22:51:28 devstack sudo[73189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:51:28 devstack sudo[73189]: pam_unix(sudo:session): session closed for user root Apr 16 22:51:28 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.459s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:28 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:28 devstack sudo[73194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 22:51:28 devstack sudo[73194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:51:29 devstack sudo[73194]: pam_unix(sudo:session): session closed for user root Apr 16 22:51:29 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.542s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:29 devstack cinder-volume[72199]: INFO cinder.volume.driver [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Driver hasn't implemented _init_vendor_properties() Apr 16 22:51:29 devstack cinder-volume[72199]: DEBUG cinder.volume.driver [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72199) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 16 22:51:29 devstack cinder-volume[72199]: DEBUG oslo_db.sqlalchemy.engines [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72199) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:51:29 devstack cinder-volume[72199]: DEBUG dbcounter [-] [72199] Writer thread running {{(pid=72199) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 22:51:29 devstack cinder-volume[72199]: DEBUG cinder.db.sqlalchemy.api [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Building query based on filter {{(pid=72199) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 16 22:51:29 devstack cinder-volume[72199]: DEBUG cinder.image.image_utils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72199) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 16 22:51:29 devstack cinder-volume[72199]: INFO cinder.keymgr.migration [None req-e49c9f68-27df-4431-b61f-2ea6d331b852 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 16 22:51:29 devstack cinder-volume[72199]: DEBUG cinder.volume.drivers.lvm [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Updating volume stats {{(pid=72199) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 22:51:29 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:29 devstack sudo[73199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 22:51:29 devstack sudo[73199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:51:29 devstack sudo[73199]: pam_unix(sudo:session): session closed for user root Apr 16 22:51:29 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.497s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:29 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:29 devstack sudo[73205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 22:51:29 devstack sudo[73205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:51:30 devstack sudo[73205]: pam_unix(sudo:session): session closed for user root Apr 16 22:51:30 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:30 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:30 devstack sudo[73210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 22:51:30 devstack sudo[73210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:51:30 devstack cinder-volume[72096]: DEBUG dbcounter [-] [72096] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72096) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:51:30 devstack sudo[73210]: pam_unix(sudo:session): session closed for user root Apr 16 22:51:30 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.476s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:30 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:30 devstack sudo[73215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 22:51:30 devstack sudo[73215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:51:31 devstack sudo[73215]: pam_unix(sudo:session): session closed for user root Apr 16 22:51:31 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.477s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:31 devstack cinder-volume[72199]: DEBUG cinder.manager [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Notifying Schedulers of capabilities ... {{(pid=72199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:51:31 devstack cinder-volume[72199]: INFO cinder.volume.manager [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Driver initialization completed successfully. Apr 16 22:51:31 devstack cinder-volume[72199]: INFO cinder.manager [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Initiating service 2 cleanup Apr 16 22:51:31 devstack cinder-volume[72199]: INFO cinder.manager [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Service 2 cleanup completed. Apr 16 22:51:31 devstack cinder-volume[72199]: DEBUG cinder.service [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Creating RPC server for service cinder-volume {{(pid=72199) start /opt/stack/cinder/cinder/service.py:231}} Apr 16 22:51:31 devstack cinder-volume[72199]: DEBUG cinder.service [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72199) start /opt/stack/cinder/cinder/service.py:237}} Apr 16 22:51:31 devstack cinder-volume[72199]: INFO cinder.volume.manager [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 16 22:51:31 devstack cinder-volume[72199]: DEBUG cinder.volume.drivers.lvm [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Updating volume stats {{(pid=72199) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 22:51:31 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:31 devstack sudo[73220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 22:51:31 devstack sudo[73220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:51:31 devstack sudo[73220]: pam_unix(sudo:session): session closed for user root Apr 16 22:51:32 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.491s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:32 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:32 devstack sudo[73228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 22:51:32 devstack sudo[73228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:51:32 devstack sudo[73228]: pam_unix(sudo:session): session closed for user root Apr 16 22:51:32 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.448s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:32 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:32 devstack sudo[73285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 22:51:32 devstack sudo[73285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:51:32 devstack sudo[73285]: pam_unix(sudo:session): session closed for user root Apr 16 22:51:32 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.441s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:32 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:51:32 devstack sudo[73288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 22:51:32 devstack sudo[73288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:51:33 devstack sudo[73288]: pam_unix(sudo:session): session closed for user root Apr 16 22:51:33 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:51:33 devstack cinder-volume[72199]: INFO cinder.volume.manager [None req-295e8be3-fa87-48dc-962d-98d8b3d0c8de None None] Driver post RPC initialization completed successfully. Apr 16 22:51:43 devstack cinder-volume[72199]: DEBUG dbcounter [-] [72199] Writing DB stats cinder:SELECT=4 {{(pid=72199) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:51:43 devstack cinder-volume[72199]: DEBUG dbcounter [-] [72199] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72199) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:52:38 devstack cinder-volume[72199]: DEBUG oslo_service.periodic_task [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72199) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:52:38 devstack cinder-volume[72199]: DEBUG cinder.volume.drivers.lvm [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] Updating volume stats {{(pid=72199) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 22:52:38 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:52:38 devstack sudo[78022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 22:52:38 devstack sudo[78022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:52:38 devstack sudo[78022]: pam_unix(sudo:session): session closed for user root Apr 16 22:52:38 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:52:38 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:52:38 devstack sudo[78025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 22:52:38 devstack sudo[78025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:52:39 devstack sudo[78025]: pam_unix(sudo:session): session closed for user root Apr 16 22:52:39 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:52:39 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:52:39 devstack sudo[78028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 22:52:39 devstack sudo[78028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:52:39 devstack sudo[78028]: pam_unix(sudo:session): session closed for user root Apr 16 22:52:39 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.456s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:52:39 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:52:39 devstack sudo[78031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 22:52:39 devstack sudo[78031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:52:40 devstack sudo[78031]: pam_unix(sudo:session): session closed for user root Apr 16 22:52:40 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.468s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:52:40 devstack cinder-volume[72199]: DEBUG cinder.manager [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] Notifying Schedulers of capabilities ... {{(pid=72199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:53:38 devstack cinder-volume[72199]: DEBUG oslo_service.periodic_task [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72199) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:53:38 devstack cinder-volume[72199]: DEBUG cinder.volume.drivers.lvm [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] Updating volume stats {{(pid=72199) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 22:53:38 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:53:38 devstack sudo[79367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 22:53:38 devstack sudo[79367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:53:38 devstack sudo[79367]: pam_unix(sudo:session): session closed for user root Apr 16 22:53:38 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:53:38 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:53:38 devstack sudo[79381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 22:53:38 devstack sudo[79381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:53:39 devstack sudo[79381]: pam_unix(sudo:session): session closed for user root Apr 16 22:53:39 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.443s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:53:39 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:53:39 devstack sudo[79405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 22:53:39 devstack sudo[79405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:53:39 devstack sudo[79405]: pam_unix(sudo:session): session closed for user root Apr 16 22:53:39 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.464s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:53:39 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:53:39 devstack sudo[79426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 22:53:39 devstack sudo[79426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:53:40 devstack sudo[79426]: pam_unix(sudo:session): session closed for user root Apr 16 22:53:40 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.481s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:53:40 devstack cinder-volume[72199]: DEBUG cinder.manager [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] Notifying Schedulers of capabilities ... {{(pid=72199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:53:43 devstack cinder-volume[72199]: DEBUG dbcounter [-] [72199] Writing DB stats cinder:SELECT=1 {{(pid=72199) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:53:43 devstack cinder-volume[72199]: DEBUG dbcounter [-] [72199] Writing DB stats cinder:UPDATE=1 {{(pid=72199) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:54:38 devstack cinder-volume[72199]: DEBUG oslo_service.periodic_task [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72199) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:54:38 devstack cinder-volume[72199]: DEBUG cinder.volume.drivers.lvm [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] Updating volume stats {{(pid=72199) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 16 22:54:38 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:54:38 devstack sudo[80907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 16 22:54:38 devstack sudo[80907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:54:38 devstack sudo[80907]: pam_unix(sudo:session): session closed for user root Apr 16 22:54:38 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:54:38 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:54:38 devstack sudo[80911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 22:54:38 devstack sudo[80911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:54:39 devstack sudo[80911]: pam_unix(sudo:session): session closed for user root Apr 16 22:54:39 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.474s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:54:39 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:54:39 devstack sudo[80914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 16 22:54:39 devstack sudo[80914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:54:39 devstack sudo[80914]: pam_unix(sudo:session): session closed for user root Apr 16 22:54:39 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.487s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:54:39 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:54:39 devstack sudo[80928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 16 22:54:39 devstack sudo[80928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:54:40 devstack sudo[80928]: pam_unix(sudo:session): session closed for user root Apr 16 22:54:40 devstack cinder-volume[72199]: DEBUG oslo_concurrency.processutils [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.472s {{(pid=72199) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:54:40 devstack cinder-volume[72199]: DEBUG cinder.manager [None req-f2d1e7b3-0c00-4105-9c80-d1dee94da15f None None] Notifying Schedulers of capabilities ... {{(pid=72199) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:54:49 devstack cinder-volume[72096]: INFO oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Caught SIGTERM, stopping children Apr 16 22:54:49 devstack cinder-volume[72096]: DEBUG oslo_concurrency.lockutils [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Acquiring lock "singleton_lock" {{(pid=72096) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 22:54:49 devstack cinder-volume[72096]: DEBUG oslo_concurrency.lockutils [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Acquired lock "singleton_lock" {{(pid=72096) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 22:54:49 devstack cinder-volume[72096]: DEBUG oslo_concurrency.lockutils [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Releasing lock "singleton_lock" {{(pid=72096) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 22:54:49 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Stop services. {{(pid=72096) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 16 22:54:49 devstack cinder-volume[72096]: DEBUG oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Killing children. {{(pid=72096) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 16 22:54:49 devstack cinder-volume[72096]: INFO oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Waiting on 1 children to exit Apr 16 22:54:51 devstack cinder-volume[72199]: DEBUG oslo_concurrency.lockutils [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Acquiring lock "singleton_lock" {{(pid=72199) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 22:54:51 devstack cinder-volume[72199]: DEBUG oslo_concurrency.lockutils [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Acquired lock "singleton_lock" {{(pid=72199) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 22:54:51 devstack cinder-volume[72199]: DEBUG oslo_concurrency.lockutils [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Releasing lock "singleton_lock" {{(pid=72199) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 22:54:51 devstack cinder-volume[72199]: WARNING amqp [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 22:54:51 devstack cinder-volume[72199]: WARNING amqp [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 22:54:51 devstack cinder-volume[72096]: INFO oslo_service.backend._eventlet.service [None req-ed8c8639-4676-441f-87fe-5879cc918428 None None] Child 72199 exited with status 0 Apr 16 22:54:51 devstack cinder-volume[81267]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 16 22:54:51 devstack cinder-volume[81267]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 22:54:51 devstack cinder-volume[81267]: we strongly recommend against using it for new projects. Apr 16 22:54:51 devstack cinder-volume[81267]: If you are already using Eventlet, we recommend migrating to a different Apr 16 22:54:51 devstack cinder-volume[81267]: framework. For more detail see Apr 16 22:54:51 devstack cinder-volume[81267]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 22:54:51 devstack cinder-volume[81267]: import eventlet # noqa Apr 16 22:54:53 devstack cinder-volume[81267]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81267) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 22:54:53 devstack cinder-volume[81267]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81267) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 22:54:53 devstack cinder-volume[81267]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81267) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 22:54:54 devstack cinder-volume[81267]: INFO dbcounter [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Registered counter for database cinder Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_db.sqlalchemy.engines [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81267) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG dbcounter [-] [81267] Writer thread running {{(pid=81267) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 22:54:54 devstack cinder-volume[81267]: INFO cinder.rpc [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 16 22:54:54 devstack cinder-volume[81267]: INFO cinder.rpc [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_db.sqlalchemy.engines [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81267) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:54:54 devstack cinder-volume[81267]: INFO cinder.volume.manager [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Determined volume DB was empty at startup. Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG cinder.volume.manager [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81267) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 16 22:54:54 devstack cinder-volume[81267]: INFO cinder.volume.manager [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 16 22:54:54 devstack cinder-volume[81267]: WARNING stevedore.named [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 22:54:54 devstack cinder-volume[81267]: WARNING castellan.key_manager [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 22:54:54 devstack cinder-volume[81267]: WARNING cinder.keymgr.conf_key_mgr [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 22:54:54 devstack cinder-volume[81267]: INFO cinder.volume.manager [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_db.sqlalchemy.engines [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81267) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:54:54 devstack cinder-volume[81267]: INFO oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Starting 1 workers Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Started child 81392 {{(pid=81267) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Full set of CONF: {{(pid=81267) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] ******************************************************************************** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Configuration options gathered from: {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] ================================================================================ {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] allow_availability_zone_fallback = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] allow_compression_on_image_upload = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] allowed_direct_url_schemes = [] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] api_rate_limit = True {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] auth_strategy = keystone {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_availability_zone = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_host = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_name = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_stats_polling_interval = 60 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backup_api_class = cinder.backup.api.API {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backup_name_template = backup-%s {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backup_use_same_host = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backup_use_temp_snapshot = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] chap_password = **** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] chap_username = {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cinder_internal_tenant_project_id = 376e1c3a4a4c4766a9a72421cca32d62 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cinder_internal_tenant_user_id = c275d7f8c72947c0a82411eda7ea0c48 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cluster = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] compression_format = gzip {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] compute_api_class = cinder.compute.nova.API {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] config_dir = [] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] config_source = [] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] control_exchange = openstack {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] debug = True {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] default_availability_zone = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] default_group_type = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] default_volume_type = QuobyteHD {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] disk_geometry = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] driver_client_cert = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] driver_client_cert_key = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81392]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] driver_data_namespace = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] driver_ssl_cert_path = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] driver_ssl_cert_verify = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] driver_use_ssl = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] enable_new_services = True {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] enable_unsupported_driver = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] enabled_backends = ['QuobyteHD'] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] enforce_multipath_for_image_xfer = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] filter_function = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] glance_api_insecure = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] glance_api_servers = ['http://192.168.122.38/image'] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] glance_api_ssl_compression = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] glance_ca_certificates_file = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] glance_catalog_info = image:glance:publicURL {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] glance_certfile = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] glance_keyfile = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] glance_num_retries = 3 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] glance_request_timeout = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] goodness_function = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] graceful_shutdown_timeout = 5 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] group_api_class = cinder.group.api.API {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] host = devstack {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] image_compress_on_upload = True {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] image_conversion_address_space_limit = 1 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] image_conversion_cpu_limit = 60 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] image_conversion_disable = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] image_upload_use_cinder_backend = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] image_upload_use_internal_tenant = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] image_volume_cache_enabled = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] image_volume_cache_max_count = 0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] image_volume_cache_max_size_gb = 0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] init_host_max_objects_retrieval = 0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] instance_format = [instance: %(uuid)s] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] iscsi_target_flags = {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] iscsi_write_cache = on {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] iser_helper = tgtadm {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] iser_ip_address = 192.168.122.38 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] iser_port = 3260 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] log_color = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] log_config_append = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] log_dir = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] log_file = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] log_options = True {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] log_rotate_interval = 1 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] log_rotate_interval_type = days {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] log_rotation_type = none {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] max_age = 0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] max_logfile_count = 30 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] max_logfile_size_mb = 200 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] max_over_subscription_ratio = 20.0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] message_reap_interval = 86400 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] message_ttl = 2592000 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] migration_create_volume_timeout_secs = 300 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] monkey_patch = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] monkey_patch_modules = [] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] my_ip = 192.168.122.38 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] no_snapshot_gb_quota = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] num_iser_scan_tries = 3 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] num_shell_tries = 3 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] num_volume_device_scan_tries = 3 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] nvmeof_conn_info_version = 1 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] nvmet_ns_id = 10 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] nvmet_port_id = 1 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] osapi_max_limit = 1000 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] osapi_volume_ext_list = [] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] osapi_volume_listen = 0.0.0.0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] osapi_volume_listen_port = 8776 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] osapi_volume_use_ssl = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] osapi_volume_workers = 2 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] per_volume_size_limit = -1 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] periodic_fuzzy_delay = 60 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] periodic_interval = 60 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] project_id_regex = [0-9a-f\-]+ {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] public_endpoint = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] publish_errors = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] quota_backup_gigabytes = 1000 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] quota_backups = 10 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] quota_gigabytes = 1000 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] quota_groups = 10 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] quota_snapshots = 10 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81392]: INFO cinder.volume.manager [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 16 22:54:54 devstack cinder-volume[81392]: DEBUG cinder.volume.drivers.remotefs [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81392) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] quota_volumes = 10 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] rate_limit_burst = 0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] rate_limit_except_level = CRITICAL {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] rate_limit_interval = 0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] reinit_driver_count = 3 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] replication_device = **** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] report_discard_supported = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] report_interval = 120 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] reservation_clean_interval = 86400 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] reservation_expire = 86400 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] reserved_image_namespaces = [] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] reserved_percentage = 0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] rpc_response_timeout = 120 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] run_external_periodic_tasks = True {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] scst_target_driver = iscsi {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] scst_target_iqn_name = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] service_down_time = 720 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] shell_completion = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] snapshot_name_template = snapshot-%s {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] split_loggers = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] state_path = /opt/stack/data/cinder {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] storage_availability_zone = nova {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] storage_protocol = iSCSI {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] syslog_log_facility = LOG_USER {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] target_helper = lioadm {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] target_ip_address = 192.168.122.38 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] target_port = 3260 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] target_protocol = iscsi {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] target_secondary_ip_addresses = [] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] trace_flags = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] transfer_api_class = cinder.transfer.api.API {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] transport_url = **** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] until_refresh = 0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] use_chap_auth = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] use_default_quota_class = True {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] use_journal = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] use_json = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] use_multipath_for_image_xfer = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] use_stderr = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] use_syslog = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] verify_glance_signatures = enabled {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] volume_api_class = cinder.volume.api.API {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] volume_backend_name = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] volume_clear = zero {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] volume_clear_ionice = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] volume_clear_size = 0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] volume_copy_bps_limit = 0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] volume_dd_blocksize = 1M {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] volume_name_template = volume-%s {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] volume_service_inithost_offload = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] volume_usage_audit_period = month {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] zoning_mode = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_concurrency.disable_process_locking = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.admin_password = **** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.admin_token = **** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.admin_user = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.auth_admin_prefix = {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.auth_port = 35357 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.auth_protocol = https {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.auth_section = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.auth_type = password {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.auth_uri = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.auth_version = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.cache = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.certfile = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.delay_auth_decision = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.http_connect_timeout = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.identity_uri = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.include_service_catalog = True {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.insecure = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.interface = public {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.keyfile = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.memcache_password = {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.memcache_username = {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.region_name = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.service_token_roles_required = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.service_type = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.token_cache_time = 300 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.38/identity {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.backend = dogpile.cache.null {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.backend_argument = **** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.backend_expiration_time = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.config_prefix = cache.oslo {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.debug_cache_backend = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.enable_retry_client = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.enable_socket_keepalive = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.enabled = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.enforce_fips_mode = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.expiration_time = 600 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.hashclient_retry_attempts = 2 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.memcache_dead_retry = 300 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.memcache_pool_maxsize = 10 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.memcache_sasl_enabled = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.password = **** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.proxies = [] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.redis_db = 0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.redis_sentinel_service_name = mymaster {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.redis_server = localhost:6379 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.retry_attempts = 2 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.retry_delay = 0.0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.socket_keepalive_count = 1 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.socket_keepalive_idle = 1 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.socket_keepalive_interval = 1 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.socket_timeout = 1.0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.tls_allowed_ciphers = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.tls_cafile = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.tls_certfile = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.tls_enabled = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.tls_keyfile = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cache.username = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] coordination.backend_url = **** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] database.asyncio_connection = **** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] database.asyncio_slave_connection = **** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] database.backend = sqlalchemy {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] database.connection = **** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] database.connection_debug = 0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] database.connection_parameters = {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] database.connection_recycle_time = 3600 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] database.connection_trace = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] database.db_inc_retry_interval = True {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] database.db_max_retries = 20 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] database.db_max_retry_interval = 10 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] database.db_retry_interval = 1 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] database.max_overflow = 50 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] database.max_pool_size = 5 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] database.max_retries = 10 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] database.mysql_wsrep_sync_wait = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] database.pool_timeout = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] database.retry_interval = 10 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] database.slave_connection = **** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] database.sqlite_synchronous = True {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] database.synchronous_reader = True {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] database.use_db_reconnect = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] profiler.connection_string = messaging:// {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] profiler.enabled = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] profiler.es_doc_type = notification {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] profiler.es_scroll_size = 10000 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] profiler.es_scroll_time = 2m {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] profiler.filter_error_trace = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] profiler.hmac_keys = **** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81392]: DEBUG cinder.volume.drivers.quobyte [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81392) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 16 22:54:54 devstack cinder-volume[81392]: WARNING cinder.volume.drivers.quobyte [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 16 22:54:54 devstack cinder-volume[81392]: WARNING cinder.volume.drivers.quobyte [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 16 22:54:54 devstack cinder-volume[81392]: DEBUG oslo_concurrency.processutils [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Running cmd (subprocess): mount.quobyte {{(pid=81392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] profiler.sentinel_service_name = mymaster {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] profiler.socket_timeout = 0.1 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] profiler.trace_requests = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] profiler.trace_sqlalchemy = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] profiler_jaeger.process_tags = {} {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] profiler_jaeger.service_name_prefix = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] profiler_otlp.service_name_prefix = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_policy.enforce_new_defaults = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: WARNING oslo_config.cfg [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_policy.enforce_scope = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_policy.policy_default_rule = default {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_policy.policy_file = policy.yaml {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_policy.remote_timeout = 60.0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] privsep_osbrick.group = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] privsep_osbrick.helper_command = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] privsep_osbrick.user = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cinder_sys_admin.group = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cinder_sys_admin.helper_command = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] cinder_sys_admin.user = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] service_user.auth_section = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] service_user.auth_type = password {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] service_user.cafile = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] service_user.certfile = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] service_user.collect_timing = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] service_user.insecure = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] service_user.keyfile = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] service_user.send_service_user_token = True {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] service_user.split_loggers = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] service_user.timeout = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] glance.auth_section = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] glance.auth_type = password {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] glance.certfile = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] glance.collect_timing = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] glance.insecure = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] glance.keyfile = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] glance.region_name = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] glance.split_loggers = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] glance.timeout = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.backend_availability_zone = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.chap_password = **** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.chap_username = {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.disk_geometry = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.driver_client_cert = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.driver_client_cert_key = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.driver_data_namespace = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.driver_use_ssl = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.enable_unsupported_driver = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.extra_capabilities = {} {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.filter_function = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.goodness_function = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.iscsi_target_flags = {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.iscsi_write_cache = on {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.iser_helper = tgtadm {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.iser_ip_address = 192.168.122.38 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.iser_port = 3260 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.nas_host = {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.nas_login = admin {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.nas_mount_options = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.nas_password = **** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.nas_private_key = {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.nas_share_path = {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.nas_ssh_port = 22 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.num_shell_tries = 3 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.nvmet_port_id = 1 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.quobyte_client_cfg = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.quobyte_volume_url = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.replication_device = **** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.report_discard_supported = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.reserved_percentage = 0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.scst_target_driver = iscsi {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.scst_target_iqn_name = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.storage_protocol = iSCSI {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.target_helper = tgtadm {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.target_ip_address = 192.168.122.38 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.target_port = 3260 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.target_protocol = iscsi {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.trace_flags = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.unique_fqdn_network = True {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.use_chap_auth = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.volume_backend_name = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.volume_clear = zero {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.volume_clear_ionice = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.volume_clear_size = 0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_reports.file_event_handler = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_reports.log_dir = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.backend_availability_zone = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.backend_host = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.chap_password = **** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.chap_username = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.chiscsi_conf = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.disk_geometry = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.driver_client_cert = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.driver_client_cert_key = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.driver_data_namespace = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.driver_use_ssl = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.extra_capabilities = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.filter_function = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.goodness_function = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.iscsi_target_flags = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.iscsi_write_cache = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.iser_helper = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.iser_ip_address = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.iser_port = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.iser_target_prefix = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.nas_host = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.nas_login = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.nas_mount_options = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.nas_password = **** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.nas_private_key = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.nas_share_path = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.nas_ssh_port = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.num_shell_tries = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.nvmet_ns_id = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.nvmet_port_id = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.replication_device = **** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.report_discard_supported = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.reserved_percentage = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.scst_target_driver = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.storage_protocol = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.target_helper = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.target_ip_address = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.target_port = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.target_prefix = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.target_protocol = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.trace_flags = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.unique_fqdn_network = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.use_chap_auth = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.volume_clear = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.volume_clear_ionice = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.volume_clear_size = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] QuobyteHD.volumes_dir = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.ssl = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.ssl_version = {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_notifications.driver = [] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_notifications.retry = -1 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] oslo_messaging_notifications.transport_url = **** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] key_manager.fixed_key = **** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican.barbican_api_version = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican.barbican_endpoint = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican.barbican_endpoint_type = public {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican.barbican_region_name = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican.cafile = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican.certfile = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican.collect_timing = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican.insecure = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican.keyfile = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican.number_of_retries = 60 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican.retry_delay = 1 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican.send_service_user_token = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican.split_loggers = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican.timeout = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican.verify_ssl = True {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican.verify_ssl_path = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican_service_user.auth_section = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican_service_user.auth_type = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican_service_user.cafile = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican_service_user.certfile = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican_service_user.collect_timing = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican_service_user.insecure = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican_service_user.keyfile = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican_service_user.split_loggers = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] barbican_service_user.timeout = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] vault.approle_role_id = **** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] vault.approle_secret_id = **** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] vault.kv_mountpoint = secret {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] vault.kv_path = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] vault.kv_version = 2 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] vault.namespace = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] vault.root_token_id = **** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] vault.ssl_ca_crt_file = None {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] vault.timeout = 60.0 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] vault.use_ssl = False {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:54:54 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] ******************************************************************************** {{(pid=81267) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 16 22:54:55 devstack quobyte-client[81393]: Reading configuration file: /etc/quobyte/client.cfg Apr 16 22:54:55 devstack quobyte-client[81393]: Invalid parameters found, error: missing mount point. Apr 16 22:54:55 devstack quobyte-client[81393]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 16 22:54:55 devstack quobyte-client[81393]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 16 22:54:55 devstack cinder-volume[81392]: DEBUG oslo_concurrency.processutils [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] CMD "mount.quobyte" returned: 1 in 0.099s {{(pid=81392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:54:55 devstack cinder-volume[81392]: DEBUG oslo_concurrency.lockutils [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:54:55 devstack cinder-volume[81392]: DEBUG oslo_concurrency.lockutils [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:54:55 devstack cinder-volume[81392]: DEBUG cinder.volume.drivers.quobyte [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:54:55 devstack cinder-volume[81392]: INFO cinder.volume.drivers.quobyte [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e ... Apr 16 22:54:55 devstack cinder-volume[81392]: DEBUG oslo_concurrency.processutils [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e -c /etc/quobyte/client-cinder.cfg {{(pid=81392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:54:55 devstack sudo[81394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e -c /etc/quobyte/client-cinder.cfg Apr 16 22:54:55 devstack sudo[81394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:54:55 devstack sudo[81394]: pam_unix(sudo:session): session closed for user root Apr 16 22:54:55 devstack cinder-volume[81392]: DEBUG oslo_concurrency.processutils [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.533s {{(pid=81392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:54:55 devstack cinder-volume[81392]: INFO cinder.volume.drivers.quobyte [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e succeeded Apr 16 22:54:55 devstack cinder-volume[81392]: DEBUG cinder.volume.drivers.quobyte [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:54:55 devstack cinder-volume[81392]: DEBUG oslo_concurrency.lockutils [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.557s {{(pid=81392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:54:55 devstack cinder-volume[81392]: DEBUG oslo_concurrency.processutils [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:54:55 devstack sudo[81475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:54:55 devstack sudo[81475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:54:55 devstack sudo[81475]: pam_unix(sudo:session): session closed for user root Apr 16 22:54:55 devstack cinder-volume[81392]: DEBUG oslo_concurrency.processutils [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.409s {{(pid=81392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:54:55 devstack cinder-volume[81392]: INFO cinder.volume.driver [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Driver hasn't implemented _init_vendor_properties() Apr 16 22:54:55 devstack cinder-volume[81392]: DEBUG cinder.volume.driver [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327690124512, 'free_capacity_gb': 1775.7327690124512, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81392) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 16 22:54:55 devstack cinder-volume[81392]: DEBUG oslo_db.sqlalchemy.engines [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81392) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:54:56 devstack cinder-volume[81392]: DEBUG dbcounter [-] [81392] Writer thread running {{(pid=81392) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 22:54:56 devstack cinder-volume[81392]: DEBUG cinder.db.sqlalchemy.api [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Building query based on filter {{(pid=81392) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 16 22:54:56 devstack cinder-volume[81392]: DEBUG cinder.image.image_utils [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81392) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 16 22:54:56 devstack cinder-volume[81392]: INFO cinder.keymgr.migration [None req-68a74405-a937-46d6-9c8f-b9f082168a90 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 16 22:54:56 devstack cinder-volume[81392]: DEBUG oslo_concurrency.lockutils [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:54:56 devstack cinder-volume[81392]: DEBUG oslo_concurrency.lockutils [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:54:56 devstack cinder-volume[81392]: DEBUG cinder.volume.drivers.quobyte [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:54:56 devstack cinder-volume[81392]: DEBUG cinder.volume.drivers.quobyte [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:54:56 devstack cinder-volume[81392]: DEBUG oslo_concurrency.lockutils [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:54:56 devstack cinder-volume[81392]: DEBUG oslo_concurrency.processutils [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:54:56 devstack sudo[81506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:54:56 devstack sudo[81506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:54:56 devstack sudo[81506]: pam_unix(sudo:session): session closed for user root Apr 16 22:54:56 devstack cinder-volume[81392]: DEBUG oslo_concurrency.processutils [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.378s {{(pid=81392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:54:56 devstack cinder-volume[81392]: DEBUG cinder.manager [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Notifying Schedulers of capabilities ... {{(pid=81392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:54:56 devstack cinder-volume[81392]: INFO cinder.volume.manager [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Driver initialization completed successfully. Apr 16 22:54:56 devstack cinder-volume[81392]: INFO cinder.manager [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Initiating service 3 cleanup Apr 16 22:54:56 devstack cinder-volume[81392]: INFO cinder.manager [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Service 3 cleanup completed. Apr 16 22:54:56 devstack cinder-volume[81392]: DEBUG cinder.service [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Creating RPC server for service cinder-volume {{(pid=81392) start /opt/stack/cinder/cinder/service.py:231}} Apr 16 22:54:56 devstack cinder-volume[81392]: DEBUG cinder.service [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81392) start /opt/stack/cinder/cinder/service.py:237}} Apr 16 22:54:56 devstack cinder-volume[81392]: INFO cinder.volume.manager [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 16 22:54:56 devstack cinder-volume[81392]: DEBUG oslo_concurrency.lockutils [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:54:56 devstack cinder-volume[81392]: DEBUG oslo_concurrency.lockutils [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:54:56 devstack cinder-volume[81392]: DEBUG cinder.volume.drivers.quobyte [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:54:56 devstack cinder-volume[81392]: DEBUG cinder.volume.drivers.quobyte [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:54:56 devstack cinder-volume[81392]: DEBUG oslo_concurrency.lockutils [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:54:56 devstack cinder-volume[81392]: DEBUG oslo_concurrency.processutils [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:54:56 devstack sudo[81546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:54:56 devstack sudo[81546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:54:57 devstack sudo[81546]: pam_unix(sudo:session): session closed for user root Apr 16 22:54:57 devstack cinder-volume[81392]: DEBUG oslo_concurrency.processutils [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.482s {{(pid=81392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:54:57 devstack cinder-volume[81392]: INFO cinder.volume.manager [None req-839dac41-2d73-4733-baab-775fa7d24ee1 None None] Driver post RPC initialization completed successfully. Apr 16 22:54:59 devstack cinder-volume[81392]: DEBUG oslo_concurrency.lockutils [None req-23945015-f930-4ec7-a4eb-3b1e29f2308a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:54:59 devstack cinder-volume[81392]: DEBUG oslo_concurrency.lockutils [None req-23945015-f930-4ec7-a4eb-3b1e29f2308a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:54:59 devstack cinder-volume[81392]: DEBUG cinder.volume.drivers.quobyte [None req-23945015-f930-4ec7-a4eb-3b1e29f2308a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81392) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:54:59 devstack cinder-volume[81392]: DEBUG cinder.volume.drivers.quobyte [None req-23945015-f930-4ec7-a4eb-3b1e29f2308a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81392) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:54:59 devstack cinder-volume[81392]: DEBUG oslo_concurrency.lockutils [None req-23945015-f930-4ec7-a4eb-3b1e29f2308a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81392) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:54:59 devstack cinder-volume[81392]: DEBUG oslo_concurrency.processutils [None req-23945015-f930-4ec7-a4eb-3b1e29f2308a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:54:59 devstack sudo[81610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:54:59 devstack sudo[81610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:55:00 devstack sudo[81610]: pam_unix(sudo:session): session closed for user root Apr 16 22:55:00 devstack cinder-volume[81392]: DEBUG oslo_concurrency.processutils [None req-23945015-f930-4ec7-a4eb-3b1e29f2308a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.440s {{(pid=81392) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:55:00 devstack cinder-volume[81392]: DEBUG cinder.manager [None req-23945015-f930-4ec7-a4eb-3b1e29f2308a None None] Notifying Schedulers of capabilities ... {{(pid=81392) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:55:03 devstack cinder-volume[81267]: INFO oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Caught SIGTERM, stopping children Apr 16 22:55:03 devstack cinder-volume[81267]: DEBUG oslo_concurrency.lockutils [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Acquiring lock "singleton_lock" {{(pid=81267) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 22:55:03 devstack cinder-volume[81267]: DEBUG oslo_concurrency.lockutils [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Acquired lock "singleton_lock" {{(pid=81267) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 22:55:03 devstack cinder-volume[81267]: DEBUG oslo_concurrency.lockutils [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Releasing lock "singleton_lock" {{(pid=81267) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 22:55:03 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Stop services. {{(pid=81267) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 16 22:55:03 devstack cinder-volume[81267]: DEBUG oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Killing children. {{(pid=81267) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 16 22:55:03 devstack cinder-volume[81267]: INFO oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Waiting on 1 children to exit Apr 16 22:55:04 devstack cinder-volume[81392]: DEBUG oslo_concurrency.lockutils [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Acquiring lock "singleton_lock" {{(pid=81392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 22:55:04 devstack cinder-volume[81392]: DEBUG oslo_concurrency.lockutils [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Acquired lock "singleton_lock" {{(pid=81392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 22:55:04 devstack cinder-volume[81392]: DEBUG oslo_concurrency.lockutils [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Releasing lock "singleton_lock" {{(pid=81392) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 22:55:04 devstack cinder-volume[81392]: WARNING amqp [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 22:55:04 devstack cinder-volume[81392]: WARNING amqp [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 16 22:55:04 devstack cinder-volume[81267]: INFO oslo_service.backend._eventlet.service [None req-def11b83-9158-4e45-90ef-ea8aff63c2ee None None] Child 81392 exited with status 0 Apr 16 22:55:05 devstack cinder-volume[81830]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 16 22:55:05 devstack cinder-volume[81830]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 22:55:05 devstack cinder-volume[81830]: we strongly recommend against using it for new projects. Apr 16 22:55:05 devstack cinder-volume[81830]: If you are already using Eventlet, we recommend migrating to a different Apr 16 22:55:05 devstack cinder-volume[81830]: framework. For more detail see Apr 16 22:55:05 devstack cinder-volume[81830]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 22:55:05 devstack cinder-volume[81830]: import eventlet # noqa Apr 16 22:55:06 devstack cinder-volume[81830]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81830) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 16 22:55:06 devstack cinder-volume[81830]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81830) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 16 22:55:06 devstack cinder-volume[81830]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81830) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 16 22:55:07 devstack cinder-volume[81830]: INFO dbcounter [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] Registered counter for database cinder Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_db.sqlalchemy.engines [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81830) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG dbcounter [-] [81830] Writer thread running {{(pid=81830) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 22:55:07 devstack cinder-volume[81830]: INFO cinder.rpc [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 16 22:55:07 devstack cinder-volume[81830]: INFO cinder.rpc [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_db.sqlalchemy.engines [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81830) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:55:07 devstack cinder-volume[81830]: INFO cinder.volume.manager [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] Determined volume DB was empty at startup. Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG cinder.volume.manager [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81830) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 16 22:55:07 devstack cinder-volume[81830]: WARNING stevedore.named [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 16 22:55:07 devstack cinder-volume[81830]: WARNING castellan.key_manager [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 22:55:07 devstack cinder-volume[81830]: WARNING cinder.keymgr.conf_key_mgr [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 16 22:55:07 devstack cinder-volume[81830]: INFO cinder.volume.manager [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_db.sqlalchemy.engines [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81830) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:55:07 devstack cinder-volume[81830]: INFO oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] Starting 1 workers Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] Started child 81971 {{(pid=81830) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] Full set of CONF: {{(pid=81830) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] ******************************************************************************** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] Configuration options gathered from: {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] ================================================================================ {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] allow_availability_zone_fallback = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] allow_compression_on_image_upload = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] allowed_direct_url_schemes = [] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] api_rate_limit = True {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] auth_strategy = keystone {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81971]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_availability_zone = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_host = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_name = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_stats_polling_interval = 60 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backup_api_class = cinder.backup.api.API {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backup_name_template = backup-%s {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backup_use_same_host = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backup_use_temp_snapshot = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] chap_password = **** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] chap_username = {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cinder_internal_tenant_project_id = 376e1c3a4a4c4766a9a72421cca32d62 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cinder_internal_tenant_user_id = c275d7f8c72947c0a82411eda7ea0c48 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cluster = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] compression_format = gzip {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] compute_api_class = cinder.compute.nova.API {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] config_dir = [] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] config_source = [] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] control_exchange = openstack {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] debug = True {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] default_availability_zone = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] default_group_type = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] default_volume_type = QuobyteHD {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] disk_geometry = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] driver_client_cert = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] driver_client_cert_key = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] driver_data_namespace = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] driver_ssl_cert_path = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] driver_ssl_cert_verify = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] driver_use_ssl = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] enable_new_services = True {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] enable_unsupported_driver = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] enabled_backends = ['QuobyteHD'] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] enforce_multipath_for_image_xfer = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] filter_function = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] glance_api_insecure = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] glance_api_servers = ['http://192.168.122.38/image'] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] glance_api_ssl_compression = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] glance_ca_certificates_file = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] glance_catalog_info = image:glance:publicURL {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] glance_certfile = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] glance_keyfile = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] glance_num_retries = 3 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] glance_request_timeout = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] goodness_function = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] graceful_shutdown_timeout = 5 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] group_api_class = cinder.group.api.API {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] host = devstack {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] image_compress_on_upload = True {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] image_conversion_address_space_limit = 1 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] image_conversion_cpu_limit = 60 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] image_conversion_disable = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] image_upload_use_cinder_backend = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] image_upload_use_internal_tenant = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] image_volume_cache_enabled = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] image_volume_cache_max_count = 0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] image_volume_cache_max_size_gb = 0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] init_host_max_objects_retrieval = 0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] instance_format = [instance: %(uuid)s] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] iscsi_target_flags = {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] iscsi_write_cache = on {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] iser_helper = tgtadm {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] iser_ip_address = 192.168.122.38 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] iser_port = 3260 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] log_color = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] log_config_append = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] log_dir = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] log_file = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] log_options = True {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] log_rotate_interval = 1 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] log_rotate_interval_type = days {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] log_rotation_type = none {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] max_age = 0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] max_logfile_count = 30 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] max_logfile_size_mb = 200 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] max_over_subscription_ratio = 20.0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81971) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] message_reap_interval = 86400 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] message_ttl = 2592000 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] migration_create_volume_timeout_secs = 300 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] monkey_patch = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] monkey_patch_modules = [] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] my_ip = 192.168.122.38 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] no_snapshot_gb_quota = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] num_iser_scan_tries = 3 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] num_shell_tries = 3 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] num_volume_device_scan_tries = 3 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] nvmeof_conn_info_version = 1 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] nvmet_ns_id = 10 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] nvmet_port_id = 1 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] osapi_max_limit = 1000 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] osapi_volume_ext_list = [] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] osapi_volume_listen_port = 8776 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] osapi_volume_use_ssl = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] osapi_volume_workers = 2 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] per_volume_size_limit = -1 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] periodic_fuzzy_delay = 60 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] periodic_interval = 60 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] public_endpoint = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] publish_errors = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] quota_backup_gigabytes = 1000 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] quota_backups = 10 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] quota_gigabytes = 1000 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] quota_groups = 10 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] quota_snapshots = 10 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] quota_volumes = 10 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] rate_limit_burst = 0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] rate_limit_except_level = CRITICAL {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] rate_limit_interval = 0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] reinit_driver_count = 3 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] replication_device = **** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] report_discard_supported = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] report_interval = 120 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] reservation_clean_interval = 86400 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] reservation_expire = 86400 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] reserved_image_namespaces = [] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] reserved_percentage = 0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] rpc_response_timeout = 120 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] run_external_periodic_tasks = True {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] scst_target_driver = iscsi {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] scst_target_iqn_name = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] service_down_time = 720 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] shell_completion = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] snapshot_name_template = snapshot-%s {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] split_loggers = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] state_path = /opt/stack/data/cinder {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] storage_availability_zone = nova {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] storage_protocol = iSCSI {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] syslog_log_facility = LOG_USER {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] target_helper = lioadm {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] target_ip_address = 192.168.122.38 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] target_port = 3260 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] target_protocol = iscsi {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] target_secondary_ip_addresses = [] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] trace_flags = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] transport_url = **** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] until_refresh = 0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] use_chap_auth = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] use_default_quota_class = True {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] use_journal = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] use_json = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] use_multipath_for_image_xfer = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] use_stderr = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] use_syslog = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] verify_glance_signatures = enabled {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] volume_api_class = cinder.volume.api.API {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] volume_backend_name = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] volume_clear = zero {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] volume_clear_ionice = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] volume_clear_size = 0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] volume_copy_bps_limit = 0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] volume_dd_blocksize = 1M {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] volume_name_template = volume-%s {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] volume_service_inithost_offload = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] volume_usage_audit_period = month {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] zoning_mode = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_concurrency.disable_process_locking = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.admin_password = **** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.admin_token = **** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.admin_user = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.auth_port = 35357 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.auth_protocol = https {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.auth_section = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.auth_type = password {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.auth_uri = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.auth_version = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.cache = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.certfile = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.identity_uri = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.include_service_catalog = True {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.insecure = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.interface = public {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.keyfile = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.memcache_password = {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.memcache_username = {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.region_name = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.service_type = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.38/identity {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.backend = dogpile.cache.null {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.backend_argument = **** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.backend_expiration_time = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.config_prefix = cache.oslo {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.debug_cache_backend = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.enable_retry_client = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.enable_socket_keepalive = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.enabled = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.enforce_fips_mode = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.expiration_time = 600 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.hashclient_retry_attempts = 2 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.memcache_dead_retry = 300 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.memcache_pool_maxsize = 10 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.memcache_sasl_enabled = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.password = **** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.proxies = [] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.redis_db = 0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.redis_server = localhost:6379 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.retry_attempts = 2 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.retry_delay = 0.0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.socket_keepalive_count = 1 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.socket_keepalive_idle = 1 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.socket_keepalive_interval = 1 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.socket_timeout = 1.0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.tls_allowed_ciphers = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.tls_cafile = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.tls_certfile = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.tls_enabled = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.tls_keyfile = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cache.username = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] coordination.backend_url = **** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] database.asyncio_connection = **** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] database.asyncio_slave_connection = **** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] database.backend = sqlalchemy {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] database.connection = **** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] database.connection_debug = 0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] database.connection_parameters = {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] database.connection_recycle_time = 3600 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] database.connection_trace = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] database.db_inc_retry_interval = True {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] database.db_max_retries = 20 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] database.db_max_retry_interval = 10 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] database.db_retry_interval = 1 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] database.max_overflow = 50 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] database.max_pool_size = 5 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] database.max_retries = 10 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] database.mysql_wsrep_sync_wait = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] database.pool_timeout = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] database.retry_interval = 10 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] database.slave_connection = **** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] database.sqlite_synchronous = True {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] database.synchronous_reader = True {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] database.use_db_reconnect = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] profiler.connection_string = messaging:// {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] profiler.enabled = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] profiler.es_doc_type = notification {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] profiler.es_scroll_size = 10000 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] profiler.es_scroll_time = 2m {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] profiler.filter_error_trace = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] profiler.hmac_keys = **** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] profiler.sentinel_service_name = mymaster {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] profiler.socket_timeout = 0.1 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] profiler.trace_requests = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] profiler.trace_sqlalchemy = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] profiler_jaeger.process_tags = {} {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] profiler_jaeger.service_name_prefix = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] profiler_otlp.service_name_prefix = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_policy.enforce_new_defaults = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: WARNING oslo_config.cfg [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_policy.enforce_scope = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_policy.policy_default_rule = default {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_policy.policy_file = policy.yaml {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] privsep_osbrick.group = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] privsep_osbrick.helper_command = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] privsep_osbrick.user = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cinder_sys_admin.group = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cinder_sys_admin.helper_command = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] cinder_sys_admin.user = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] service_user.auth_section = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] service_user.auth_type = password {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] service_user.cafile = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] service_user.certfile = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] service_user.collect_timing = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] service_user.insecure = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] service_user.keyfile = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] service_user.send_service_user_token = True {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] service_user.split_loggers = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] service_user.timeout = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] glance.auth_section = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] glance.auth_type = password {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] glance.certfile = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] glance.collect_timing = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] glance.insecure = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] glance.keyfile = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] glance.region_name = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] glance.split_loggers = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] glance.timeout = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.backend_availability_zone = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.chap_password = **** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.chap_username = {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81971) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 16 22:55:07 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.quobyte [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 16 22:55:07 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.quobyte [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.disk_geometry = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.driver_client_cert = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.driver_client_cert_key = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.driver_data_namespace = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.driver_use_ssl = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Running cmd (subprocess): mount.quobyte {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.extra_capabilities = {} {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.filter_function = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.goodness_function = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.iscsi_target_flags = {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.iscsi_write_cache = on {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.iser_helper = tgtadm {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.iser_ip_address = 192.168.122.38 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.iser_port = 3260 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.nas_host = {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.nas_login = admin {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.nas_mount_options = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.nas_password = **** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.nas_private_key = {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.nas_share_path = {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.num_shell_tries = 3 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.quobyte_volume_url = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.replication_device = **** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.report_discard_supported = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.reserved_percentage = 0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.target_helper = tgtadm {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.target_ip_address = 192.168.122.38 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.target_port = 3260 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.target_protocol = iscsi {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.trace_flags = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.unique_fqdn_network = True {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.use_chap_auth = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.volume_backend_name = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.volume_clear = zero {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.volume_clear_ionice = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.volume_clear_size = 0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_reports.file_event_handler = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_reports.log_dir = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.backend_availability_zone = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.backend_host = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.chap_password = **** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.chap_username = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.chiscsi_conf = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.disk_geometry = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.driver_client_cert = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.driver_data_namespace = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.driver_use_ssl = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.extra_capabilities = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.filter_function = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.goodness_function = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.iser_helper = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.iser_ip_address = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.iser_port = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.iser_target_prefix = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.nas_host = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.nas_login = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.nas_mount_options = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.nas_password = **** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.nas_private_key = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.nas_share_path = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.nas_ssh_port = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.num_shell_tries = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.nvmet_port_id = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.replication_device = **** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.report_discard_supported = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.reserved_percentage = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.scst_target_driver = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.storage_protocol = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.target_helper = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.target_ip_address = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.target_port = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.target_prefix = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.target_protocol = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.trace_flags = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.use_chap_auth = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.volume_clear = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.volume_clear_size = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] QuobyteHD.volumes_dir = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack quobyte-client[81972]: Reading configuration file: /etc/quobyte/client.cfg Apr 16 22:55:07 devstack quobyte-client[81972]: Invalid parameters found, error: missing mount point. Apr 16 22:55:07 devstack quobyte-client[81972]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 16 22:55:07 devstack quobyte-client[81972]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.ssl = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_notifications.driver = [] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_notifications.retry = -1 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] CMD "mount.quobyte" returned: 1 in 0.112s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] key_manager.fixed_key = **** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:55:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:55:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican.barbican_api_version = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican.barbican_endpoint = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican.barbican_endpoint_type = public {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican.barbican_region_name = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican.cafile = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican.certfile = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican.collect_timing = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican.insecure = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican.keyfile = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican.number_of_retries = 60 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican.retry_delay = 1 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican.send_service_user_token = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican.split_loggers = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican.timeout = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican.verify_ssl = True {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican.verify_ssl_path = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican_service_user.auth_section = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican_service_user.auth_type = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican_service_user.cafile = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican_service_user.certfile = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican_service_user.collect_timing = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican_service_user.insecure = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican_service_user.keyfile = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican_service_user.split_loggers = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] barbican_service_user.timeout = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] vault.approle_role_id = **** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] vault.approle_secret_id = **** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] vault.kv_mountpoint = secret {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] vault.kv_path = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] vault.kv_version = 2 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] vault.namespace = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] vault.root_token_id = **** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] vault.ssl_ca_crt_file = None {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] vault.timeout = 60.0 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] vault.use_ssl = False {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 16 22:55:07 devstack cinder-volume[81830]: DEBUG oslo_service.backend._eventlet.service [None req-c525956f-e086-4c1e-b110-708a15ba39d4 None None] ******************************************************************************** {{(pid=81830) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 16 22:55:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:55:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:55:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:55:07 devstack sudo[81980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:55:07 devstack sudo[81980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:55:08 devstack sudo[81980]: pam_unix(sudo:session): session closed for user root Apr 16 22:55:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.675s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:55:08 devstack cinder-volume[81971]: INFO cinder.volume.driver [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Driver hasn't implemented _init_vendor_properties() Apr 16 22:55:08 devstack cinder-volume[81971]: DEBUG cinder.volume.driver [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327690124512, 'free_capacity_gb': 1775.7327690124512, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81971) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 16 22:55:08 devstack cinder-volume[81971]: DEBUG oslo_db.sqlalchemy.engines [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81971) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 16 22:55:08 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writer thread running {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 16 22:55:08 devstack cinder-volume[81971]: DEBUG cinder.db.sqlalchemy.api [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Building query based on filter {{(pid=81971) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 16 22:55:08 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81971) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 16 22:55:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:55:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:55:08 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:55:08 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:55:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:55:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:55:08 devstack cinder-volume[81971]: INFO cinder.keymgr.migration [None req-ce72ce2f-eb25-4a20-8621-828440e3525f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 16 22:55:08 devstack sudo[82058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:55:08 devstack sudo[82058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:55:09 devstack sudo[82058]: pam_unix(sudo:session): session closed for user root Apr 16 22:55:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.556s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:55:09 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:55:09 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Driver initialization completed successfully. Apr 16 22:55:09 devstack cinder-volume[81971]: INFO cinder.manager [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Initiating service 3 cleanup Apr 16 22:55:09 devstack cinder-volume[81971]: INFO cinder.manager [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Service 3 cleanup completed. Apr 16 22:55:09 devstack cinder-volume[81971]: DEBUG cinder.service [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Creating RPC server for service cinder-volume {{(pid=81971) start /opt/stack/cinder/cinder/service.py:231}} Apr 16 22:55:09 devstack cinder-volume[81971]: DEBUG cinder.service [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81971) start /opt/stack/cinder/cinder/service.py:237}} Apr 16 22:55:09 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 16 22:55:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:55:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:55:09 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:55:09 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:55:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:55:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:55:09 devstack sudo[82077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:55:09 devstack sudo[82077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:55:09 devstack sudo[82077]: pam_unix(sudo:session): session closed for user root Apr 16 22:55:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.430s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:55:09 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-9aa98eaf-389f-4ae5-880a-5e52d60eb567 None None] Driver post RPC initialization completed successfully. Apr 16 22:55:17 devstack cinder-volume[81830]: DEBUG dbcounter [-] [81830] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81830) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:55:19 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:SELECT=2 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:55:19 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Flow 'volume_create_manager' (e36574e8-8dcb-4122-87dc-e8ec8cf36426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7269f0d2-b6b2-44db-98e6-e8f283816170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Flow 'volume_create_manager' (c16875df-7d46-432d-80d3-429d3d53ce30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61642b7-cdc9-4ffc-94ae-6b70b8a7eddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7269f0d2-b6b2-44db-98e6-e8f283816170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1556996048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed6dd743-9bc7-43de-a74c-f18da181c5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27279de68f76432ca8c383a7d3bd7252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:56:10Z,use_quota=True,user_id='9b1bd81b2e27481aa5572ad923f48a10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af5fbc0-2b77-4ad2-b690-0ebbb60a2ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5af5fbc0-2b77-4ad2-b690-0ebbb60a2ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5819cc55-01ef-4b0c-983f-fb46ba5fc007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5819cc55-01ef-4b0c-983f-fb46ba5fc007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed6dd743-9bc7-43de-a74c-f18da181c5ff', 'volume_name': 'volume-ed6dd743-9bc7-43de-a74c-f18da181c5ff', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c73f586-d421-41cc-a49d-8c60287acf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c73f586-d421-41cc-a49d-8c60287acf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27c0c9c-1e30-474c-a4fc-378746e9f6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:09 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Volume ed6dd743-9bc7-43de-a74c-f18da181c5ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed6dd743-9bc7-43de-a74c-f18da181c5ff', 'volume_size': 1} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:56:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1556996048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed6dd743-9bc7-43de-a74c-f18da181c5ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27279de68f76432ca8c383a7d3bd7252',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:56:10Z,use_quota=True,user_id='9b1bd81b2e27481aa5572ad923f48a10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Creating volume ed6dd743-9bc7-43de-a74c-f18da181c5ff {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:56:09 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ed6dd743-9bc7-43de-a74c-f18da181c5ff 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61642b7-cdc9-4ffc-94ae-6b70b8a7eddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-10187321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dccd69f-624c-447d-b1f1-0f81661ff12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f718e2bb6a4e4ba4ae66f68e429981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:56:10Z,use_quota=True,user_id='6452e6b5f0754c5891ae6f3a9f8c10fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:09 devstack sudo[82582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ed6dd743-9bc7-43de-a74c-f18da181c5ff 1073741824 Apr 16 22:56:09 devstack sudo[82582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88cab250-8634-4374-997d-096ef52f0e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88cab250-8634-4374-997d-096ef52f0e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f6a8f9f-85ef-4f32-baae-576d8d796a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f6a8f9f-85ef-4f32-baae-576d8d796a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dccd69f-624c-447d-b1f1-0f81661ff12b', 'volume_name': 'volume-4dccd69f-624c-447d-b1f1-0f81661ff12b', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf2fafb-3049-4bf0-9932-8ca3ceec11d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf2fafb-3049-4bf0-9932-8ca3ceec11d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdfca8b9-acda-4352-b712-ba9d596e0ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:09 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Volume 4dccd69f-624c-447d-b1f1-0f81661ff12b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dccd69f-624c-447d-b1f1-0f81661ff12b', 'volume_size': 1} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Flow 'volume_create_manager' (b8da4c0b-de44-492c-a831-8c9be29be81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56eacda5-6ef8-4b3c-947c-0d07748b2be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56eacda5-6ef8-4b3c-947c-0d07748b2be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-215557544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='40b2f55b887443a1bf926826f20a7f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:56:10Z,use_quota=True,user_id='5471afd9bdd64c8ea8deb4012cc82ec6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dea626a-77ae-4abe-b134-a23fffd52874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dea626a-77ae-4abe-b134-a23fffd52874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b37837-48a5-4a1a-89e1-de04a5a8eb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3b37837-48a5-4a1a-89e1-de04a5a8eb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9', 'volume_name': 'volume-c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae50246-8097-4d74-9442-06db9159c0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae50246-8097-4d74-9442-06db9159c0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1defa11-9942-471e-9bf2-90172b0d68b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:09 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Volume c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9', 'volume_size': 1} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Flow 'volume_create_manager' (4b2fe8c6-95fc-4f9b-92d6-3aaa2e292d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:56:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5329cc18-e9ef-452e-bc4b-3dee9481c06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5329cc18-e9ef-452e-bc4b-3dee9481c06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-470945875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c82c33b-997c-4381-86da-977d3c190edf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66ff61340124414a938d3a75fa224563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:56:10Z,use_quota=True,user_id='a61554af05c24419a5ed95d0ab4c5c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01514ee9-ec20-4696-9952-4abba6c7f94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01514ee9-ec20-4696-9952-4abba6c7f94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (309dceef-e69f-4ad0-b7d5-8f16fbec7bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (309dceef-e69f-4ad0-b7d5-8f16fbec7bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c82c33b-997c-4381-86da-977d3c190edf', 'volume_name': 'volume-2c82c33b-997c-4381-86da-977d3c190edf', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f5a2e60-140e-4353-ae28-f08bcc04bc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f5a2e60-140e-4353-ae28-f08bcc04bc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8fce5d-d9dd-49fc-b8ff-dfaaafba8ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:10 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Volume 2c82c33b-997c-4381-86da-977d3c190edf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c82c33b-997c-4381-86da-977d3c190edf', 'volume_size': 1} Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:10 devstack sudo[82582]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ed6dd743-9bc7-43de-a74c-f18da181c5ff 1073741824" returned: 0 in 0.597s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ed6dd743-9bc7-43de-a74c-f18da181c5ff {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:10 devstack sudo[82900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ed6dd743-9bc7-43de-a74c-f18da181c5ff Apr 16 22:56:10 devstack sudo[82900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:10 devstack sudo[82900]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ed6dd743-9bc7-43de-a74c-f18da181c5ff" returned: 0 in 0.439s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.025s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-10187321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dccd69f-624c-447d-b1f1-0f81661ff12b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93f718e2bb6a4e4ba4ae66f68e429981',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:56:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:56:10Z,use_quota=True,user_id='6452e6b5f0754c5891ae6f3a9f8c10fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Creating volume 4dccd69f-624c-447d-b1f1-0f81661ff12b {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:56:10 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4dccd69f-624c-447d-b1f1-0f81661ff12b 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27c0c9c-1e30-474c-a4fc-378746e9f6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed6dd743-9bc7-43de-a74c-f18da181c5ff', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:10 devstack sudo[82903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4dccd69f-624c-447d-b1f1-0f81661ff12b 1073741824 Apr 16 22:56:10 devstack sudo[82903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebdc757b-273d-4120-ab37-47631e78bd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:10 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Volume volume-ed6dd743-9bc7-43de-a74c-f18da181c5ff (ed6dd743-9bc7-43de-a74c-f18da181c5ff): created successfully Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebdc757b-273d-4120-ab37-47631e78bd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Flow 'volume_create_manager' (e36574e8-8dcb-4122-87dc-e8ec8cf36426) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:56:10 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-f59ac149-8a25-436f-9c2d-e60553e9367f tempest-VolumesAdminNegativeTest-778676827 None] Created volume successfully. Apr 16 22:56:11 devstack sudo[82903]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4dccd69f-624c-447d-b1f1-0f81661ff12b 1073741824" returned: 0 in 0.563s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4dccd69f-624c-447d-b1f1-0f81661ff12b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:11 devstack sudo[82908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4dccd69f-624c-447d-b1f1-0f81661ff12b Apr 16 22:56:11 devstack sudo[82908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a5b00b48-f7b3-44ea-b585-567884393ea7 tempest-VolumesAdminNegativeTest-778676827 None] Acquiring lock "cinder-ed6dd743-9bc7-43de-a74c-f18da181c5ff-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:56:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a5b00b48-f7b3-44ea-b585-567884393ea7 tempest-VolumesAdminNegativeTest-778676827 None] Lock "cinder-ed6dd743-9bc7-43de-a74c-f18da181c5ff-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:56:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a5b00b48-f7b3-44ea-b585-567884393ea7 tempest-VolumesAdminNegativeTest-778676827 None] Acquiring lock "cinder-quobyte-ed6dd743-9bc7-43de-a74c-f18da181c5ff" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:56:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a5b00b48-f7b3-44ea-b585-567884393ea7 tempest-VolumesAdminNegativeTest-778676827 None] Lock "cinder-quobyte-ed6dd743-9bc7-43de-a74c-f18da181c5ff" acquired by "delete_volume" :: waited 0.009s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:56:12 devstack cinder-volume[81971]: INFO oslo.privsep.daemon [None req-a5b00b48-f7b3-44ea-b585-567884393ea7 tempest-VolumesAdminNegativeTest-778676827 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpm0a3322a/privsep.sock'] Apr 16 22:56:12 devstack sudo[82912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpm0a3322a/privsep.sock Apr 16 22:56:12 devstack sudo[82912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:12 devstack sudo[82908]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4dccd69f-624c-447d-b1f1-0f81661ff12b" returned: 0 in 0.654s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:56:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.191s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-215557544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='40b2f55b887443a1bf926826f20a7f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:56:10Z,use_quota=True,user_id='5471afd9bdd64c8ea8deb4012cc82ec6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:56:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Creating volume c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:56:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:56:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:56:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:56:12 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:56:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:12 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdfca8b9-acda-4352-b712-ba9d596e0ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dccd69f-624c-447d-b1f1-0f81661ff12b', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:12 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f87876c-c900-4364-b3a1-58a818a9dbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:12 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Volume volume-4dccd69f-624c-447d-b1f1-0f81661ff12b (4dccd69f-624c-447d-b1f1-0f81661ff12b): created successfully Apr 16 22:56:12 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f87876c-c900-4364-b3a1-58a818a9dbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:12 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Flow 'volume_create_manager' (c16875df-7d46-432d-80d3-429d3d53ce30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:56:12 devstack sudo[82914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9 1073741824 Apr 16 22:56:12 devstack sudo[82914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:12 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-ba64132d-e850-47e1-a9f4-ec7768cb59a2 tempest-DeleteServersTestJSON-245294933 None] Created volume successfully. Apr 16 22:56:12 devstack cinder-volume[81971]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 16 22:56:12 devstack cinder-volume[81971]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 22:56:12 devstack cinder-volume[81971]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 16 22:56:12 devstack cinder-volume[81971]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 22:56:12 devstack cinder-volume[81971]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 16 22:56:12 devstack cinder-volume[81971]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 16 22:56:12 devstack cinder-volume[81971]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 22:56:12 devstack cinder-volume[81971]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 22:56:12 devstack cinder-volume[81971]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 16 22:56:12 devstack sudo[82914]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9 1073741824" returned: 0 in 0.644s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:12 devstack cinder-volume[81971]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 16 22:56:12 devstack cinder-volume[81971]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 16 22:56:12 devstack cinder-volume[81971]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 16 22:56:12 devstack cinder-volume[81971]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 22:56:12 devstack cinder-volume[81971]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 16 22:56:12 devstack cinder-volume[81971]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 16 22:56:12 devstack cinder-volume[81971]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 16 22:56:12 devstack cinder-volume[81971]: WARNING oslo.privsep.daemon [-] privsep log: Apr 16 22:56:12 devstack cinder-volume[81971]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 16 22:56:12 devstack sudo[82920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9 Apr 16 22:56:12 devstack sudo[82920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:13 devstack sudo[82920]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9" returned: 0 in 0.622s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:56:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.366s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-470945875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c82c33b-997c-4381-86da-977d3c190edf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66ff61340124414a938d3a75fa224563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:56:10Z,use_quota=True,user_id='a61554af05c24419a5ed95d0ab4c5c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:56:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Creating volume 2c82c33b-997c-4381-86da-977d3c190edf {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:56:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:56:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:56:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:56:13 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:56:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2c82c33b-997c-4381-86da-977d3c190edf 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1defa11-9942-471e-9bf2-90172b0d68b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f11c818-da42-4b00-8cb9-82c0da4dd24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:13 devstack sudo[82931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2c82c33b-997c-4381-86da-977d3c190edf 1073741824 Apr 16 22:56:13 devstack sudo[82931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:13 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Volume volume-c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9 (c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9): created successfully Apr 16 22:56:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f11c818-da42-4b00-8cb9-82c0da4dd24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Flow 'volume_create_manager' (b8da4c0b-de44-492c-a831-8c9be29be81a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:56:13 devstack sudo[82912]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:13 devstack cinder-volume[81971]: INFO oslo.privsep.daemon [None req-a5b00b48-f7b3-44ea-b585-567884393ea7 tempest-VolumesAdminNegativeTest-778676827 None] Spawned new privsep daemon via rootwrap Apr 16 22:56:13 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [None req-a5b00b48-f7b3-44ea-b585-567884393ea7 tempest-VolumesAdminNegativeTest-778676827 None] Accepted privsep connection to /tmp/tmpm0a3322a/privsep.sock {{(pid=81971) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 16 22:56:13 devstack cinder-volume[81971]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 16 22:56:13 devstack cinder-volume[81971]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 16 22:56:13 devstack cinder-volume[81971]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 16 22:56:13 devstack cinder-volume[81971]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82922 Apr 16 22:56:13 devstack cinder-volume[81971]: INFO cinder.volume.manager [req-68299280-24ae-4843-b99a-2fadac95b3b0 req-9ec93121-c9f1-4908-80aa-bd2088eae2e4 tempest-VolumesGetTestJSON-2088029544 None] Created volume successfully. Apr 16 22:56:13 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[018c1583-e114-4b1f-a2cd-26f952162dc2]: (2,) {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:56:13 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[6620651e-ee4b-49af-9d60-9bf0f92d26a7]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:56:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a5b00b48-f7b3-44ea-b585-567884393ea7 tempest-VolumesAdminNegativeTest-778676827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ed6dd743-9bc7-43de-a74c-f18da181c5ff {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:13 devstack sudo[82934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ed6dd743-9bc7-43de-a74c-f18da181c5ff Apr 16 22:56:13 devstack sudo[82934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:14 devstack sudo[82931]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2c82c33b-997c-4381-86da-977d3c190edf 1073741824" returned: 0 in 0.721s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:14 devstack sudo[82934]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a5b00b48-f7b3-44ea-b585-567884393ea7 tempest-VolumesAdminNegativeTest-778676827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ed6dd743-9bc7-43de-a74c-f18da181c5ff" returned: 0 in 0.671s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a5b00b48-f7b3-44ea-b585-567884393ea7 tempest-VolumesAdminNegativeTest-778676827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ed6dd743-9bc7-43de-a74c-f18da181c5ff {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2c82c33b-997c-4381-86da-977d3c190edf {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:14 devstack sudo[82943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ed6dd743-9bc7-43de-a74c-f18da181c5ff Apr 16 22:56:14 devstack sudo[82943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:14 devstack sudo[82945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2c82c33b-997c-4381-86da-977d3c190edf Apr 16 22:56:14 devstack sudo[82945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-e5a2e833-bf12-40ea-a3c1-8be5ee3f4dad req-8b2ed511-649d-4b2f-b861-55b45c9b5234 tempest-VolumesGetTestJSON-2088029544 None] Acquiring lock "cinder-c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:56:14 devstack sudo[82945]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-e5a2e833-bf12-40ea-a3c1-8be5ee3f4dad req-8b2ed511-649d-4b2f-b861-55b45c9b5234 tempest-VolumesGetTestJSON-2088029544 None] Lock "cinder-c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:56:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2c82c33b-997c-4381-86da-977d3c190edf" returned: 0 in 0.638s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:14 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:56:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:14 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8fce5d-d9dd-49fc-b8ff-dfaaafba8ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c82c33b-997c-4381-86da-977d3c190edf', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:14 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e409d3f9-2641-43cf-907d-f640474c1420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-e5a2e833-bf12-40ea-a3c1-8be5ee3f4dad req-8b2ed511-649d-4b2f-b861-55b45c9b5234 tempest-VolumesGetTestJSON-2088029544 None] Acquiring lock "cinder-quobyte-c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:56:14 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Volume volume-2c82c33b-997c-4381-86da-977d3c190edf (2c82c33b-997c-4381-86da-977d3c190edf): created successfully Apr 16 22:56:14 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e409d3f9-2641-43cf-907d-f640474c1420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:14 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Flow 'volume_create_manager' (4b2fe8c6-95fc-4f9b-92d6-3aaa2e292d2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:56:14 devstack sudo[82943]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-e5a2e833-bf12-40ea-a3c1-8be5ee3f4dad req-8b2ed511-649d-4b2f-b861-55b45c9b5234 tempest-VolumesGetTestJSON-2088029544 None] Lock "cinder-quobyte-c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9" acquired by "delete_volume" :: waited 0.027s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:56:14 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-b0fdabae-1336-43ea-9fc4-37b6a8e2652c tempest-VolumesTestJSON-1825858516 None] Created volume successfully. Apr 16 22:56:14 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6efddc-ec1f-4ca6-9adc-834a75d828f4]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:56:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-e5a2e833-bf12-40ea-a3c1-8be5ee3f4dad req-8b2ed511-649d-4b2f-b861-55b45c9b5234 tempest-VolumesGetTestJSON-2088029544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a5b00b48-f7b3-44ea-b585-567884393ea7 tempest-VolumesAdminNegativeTest-778676827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ed6dd743-9bc7-43de-a74c-f18da181c5ff" returned: 0 in 0.797s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a5b00b48-f7b3-44ea-b585-567884393ea7 tempest-VolumesAdminNegativeTest-778676827 None] Lock "cinder-quobyte-ed6dd743-9bc7-43de-a74c-f18da181c5ff" released by "delete_volume" :: held 2.994s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:56:15 devstack sudo[82951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9 Apr 16 22:56:15 devstack sudo[82951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:15 devstack cinder-volume[81971]: WARNING cinder.quota [None req-a5b00b48-f7b3-44ea-b585-567884393ea7 tempest-VolumesAdminNegativeTest-778676827 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:56:15 devstack cinder-volume[81971]: WARNING cinder.quota [None req-a5b00b48-f7b3-44ea-b585-567884393ea7 tempest-VolumesAdminNegativeTest-778676827 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-a5b00b48-f7b3-44ea-b585-567884393ea7 tempest-VolumesAdminNegativeTest-778676827 None] Created reservations ['65ff2ec4-49b8-4baa-8d72-3baab2a032ab', '8add4d2d-ab83-4bf5-9663-7fb316ef260d', 'e018b1f2-5011-4737-9488-9401f02cadc5', 'c13ac9b1-c0d5-4dd3-8cdb-80a521be59ff'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a5b00b48-f7b3-44ea-b585-567884393ea7 tempest-VolumesAdminNegativeTest-778676827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a5b00b48-f7b3-44ea-b585-567884393ea7 tempest-VolumesAdminNegativeTest-778676827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a5b00b48-f7b3-44ea-b585-567884393ea7 tempest-VolumesAdminNegativeTest-778676827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a5b00b48-f7b3-44ea-b585-567884393ea7 tempest-VolumesAdminNegativeTest-778676827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a5b00b48-f7b3-44ea-b585-567884393ea7 tempest-VolumesAdminNegativeTest-778676827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a5b00b48-f7b3-44ea-b585-567884393ea7 tempest-VolumesAdminNegativeTest-778676827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:15 devstack sudo[82953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:56:15 devstack sudo[82953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Flow 'volume_create_manager' (cf171bb6-126e-4bce-948f-8567427e6794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af1724c-a9ed-4611-9c26-0a391a148a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4af1724c-a9ed-4611-9c26-0a391a148a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-497865046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67bac142-cb6f-4591-a416-5d04da56e5c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66ff61340124414a938d3a75fa224563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:56:16Z,use_quota=True,user_id='a61554af05c24419a5ed95d0ab4c5c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c8d8ac-4870-4f54-b72b-ab7efcf838ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c8d8ac-4870-4f54-b72b-ab7efcf838ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b745af-2b37-49a5-95b8-12c179710cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b745af-2b37-49a5-95b8-12c179710cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67bac142-cb6f-4591-a416-5d04da56e5c5', 'volume_name': 'volume-67bac142-cb6f-4591-a416-5d04da56e5c5', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9745856f-5222-4466-9502-da6944b62262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9745856f-5222-4466-9502-da6944b62262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa562a6-2f78-432a-a818-7059c12f441b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:15 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Volume 67bac142-cb6f-4591-a416-5d04da56e5c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67bac142-cb6f-4591-a416-5d04da56e5c5', 'volume_size': 1} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:56:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-497865046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67bac142-cb6f-4591-a416-5d04da56e5c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66ff61340124414a938d3a75fa224563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:56:16Z,use_quota=True,user_id='a61554af05c24419a5ed95d0ab4c5c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Creating volume 67bac142-cb6f-4591-a416-5d04da56e5c5 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:56:15 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:56:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-67bac142-cb6f-4591-a416-5d04da56e5c5 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:16 devstack sudo[82960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-67bac142-cb6f-4591-a416-5d04da56e5c5 1073741824 Apr 16 22:56:16 devstack sudo[82960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:16 devstack sudo[82953]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a5b00b48-f7b3-44ea-b585-567884393ea7 tempest-VolumesAdminNegativeTest-778676827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.931s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:16 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-a5b00b48-f7b3-44ea-b585-567884393ea7 tempest-VolumesAdminNegativeTest-778676827 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:56:16 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-a5b00b48-f7b3-44ea-b585-567884393ea7 tempest-VolumesAdminNegativeTest-778676827 None] Deleted volume successfully. Apr 16 22:56:16 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a5b00b48-f7b3-44ea-b585-567884393ea7 tempest-VolumesAdminNegativeTest-778676827 None] Lock "cinder-ed6dd743-9bc7-43de-a74c-f18da181c5ff-delete_volume" released by "delete_volume" :: held 4.242s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:56:16 devstack sudo[82951]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-e5a2e833-bf12-40ea-a3c1-8be5ee3f4dad req-8b2ed511-649d-4b2f-b861-55b45c9b5234 tempest-VolumesGetTestJSON-2088029544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9" returned: 0 in 1.311s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-e5a2e833-bf12-40ea-a3c1-8be5ee3f4dad req-8b2ed511-649d-4b2f-b861-55b45c9b5234 tempest-VolumesGetTestJSON-2088029544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:16 devstack sudo[82965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9 Apr 16 22:56:16 devstack sudo[82965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:16 devstack sudo[82965]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-e5a2e833-bf12-40ea-a3c1-8be5ee3f4dad req-8b2ed511-649d-4b2f-b861-55b45c9b5234 tempest-VolumesGetTestJSON-2088029544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9" returned: 0 in 0.621s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:16 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-e5a2e833-bf12-40ea-a3c1-8be5ee3f4dad req-8b2ed511-649d-4b2f-b861-55b45c9b5234 tempest-VolumesGetTestJSON-2088029544 None] Lock "cinder-quobyte-c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9" released by "delete_volume" :: held 1.960s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:56:16 devstack cinder-volume[81971]: DEBUG cinder.quota [req-e5a2e833-bf12-40ea-a3c1-8be5ee3f4dad req-8b2ed511-649d-4b2f-b861-55b45c9b5234 tempest-VolumesGetTestJSON-2088029544 None] Created reservations ['50165dcb-fa3f-49ee-a65b-fa98423d5f15', 'e016119a-2790-4790-af5b-6d43661e8974', 'c9b25f83-da7c-4535-b2cf-506d5f55e40b', '9c952cd1-b949-4a58-8456-9a2d17cfb3aa'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:56:16 devstack sudo[82960]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-67bac142-cb6f-4591-a416-5d04da56e5c5 1073741824" returned: 0 in 0.983s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-67bac142-cb6f-4591-a416-5d04da56e5c5 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-e5a2e833-bf12-40ea-a3c1-8be5ee3f4dad req-8b2ed511-649d-4b2f-b861-55b45c9b5234 tempest-VolumesGetTestJSON-2088029544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-e5a2e833-bf12-40ea-a3c1-8be5ee3f4dad req-8b2ed511-649d-4b2f-b861-55b45c9b5234 tempest-VolumesGetTestJSON-2088029544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:17 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-e5a2e833-bf12-40ea-a3c1-8be5ee3f4dad req-8b2ed511-649d-4b2f-b861-55b45c9b5234 tempest-VolumesGetTestJSON-2088029544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:56:17 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-e5a2e833-bf12-40ea-a3c1-8be5ee3f4dad req-8b2ed511-649d-4b2f-b861-55b45c9b5234 tempest-VolumesGetTestJSON-2088029544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:56:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-e5a2e833-bf12-40ea-a3c1-8be5ee3f4dad req-8b2ed511-649d-4b2f-b861-55b45c9b5234 tempest-VolumesGetTestJSON-2088029544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-e5a2e833-bf12-40ea-a3c1-8be5ee3f4dad req-8b2ed511-649d-4b2f-b861-55b45c9b5234 tempest-VolumesGetTestJSON-2088029544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:17 devstack sudo[82982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-67bac142-cb6f-4591-a416-5d04da56e5c5 Apr 16 22:56:17 devstack sudo[82982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:17 devstack sudo[82983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:56:17 devstack sudo[82983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:17 devstack sudo[82983]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-e5a2e833-bf12-40ea-a3c1-8be5ee3f4dad req-8b2ed511-649d-4b2f-b861-55b45c9b5234 tempest-VolumesGetTestJSON-2088029544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.815s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:17 devstack cinder-volume[81971]: DEBUG cinder.manager [req-e5a2e833-bf12-40ea-a3c1-8be5ee3f4dad req-8b2ed511-649d-4b2f-b861-55b45c9b5234 tempest-VolumesGetTestJSON-2088029544 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:56:17 devstack cinder-volume[81971]: INFO cinder.volume.manager [req-e5a2e833-bf12-40ea-a3c1-8be5ee3f4dad req-8b2ed511-649d-4b2f-b861-55b45c9b5234 tempest-VolumesGetTestJSON-2088029544 None] Deleted volume successfully. Apr 16 22:56:17 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-e5a2e833-bf12-40ea-a3c1-8be5ee3f4dad req-8b2ed511-649d-4b2f-b861-55b45c9b5234 tempest-VolumesGetTestJSON-2088029544 None] Lock "cinder-c25bcd16-d78e-4eec-a8f7-5ddbf2a8d6b9-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:56:18 devstack sudo[82982]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-67bac142-cb6f-4591-a416-5d04da56e5c5" returned: 0 in 1.093s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:18 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] <== create_volume: return (2178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:56:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.182s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daa562a6-2f78-432a-a818-7059c12f441b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67bac142-cb6f-4591-a416-5d04da56e5c5', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e03d6e2e-1b0f-4c7c-994b-1edfcbcc81ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:18 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Volume volume-67bac142-cb6f-4591-a416-5d04da56e5c5 (67bac142-cb6f-4591-a416-5d04da56e5c5): created successfully Apr 16 22:56:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e03d6e2e-1b0f-4c7c-994b-1edfcbcc81ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Flow 'volume_create_manager' (cf171bb6-126e-4bce-948f-8567427e6794) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:56:18 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-3f3d8119-c751-4ce6-859f-8279df7429bf tempest-VolumesTestJSON-1825858516 None] Created volume successfully. Apr 16 22:56:18 devstack cinder-volume[81971]: WARNING py.warnings [req-3ecd62ce-bccf-42c8-a144-da4fbcbb7f5f req-d235167e-3115-4cd4-abb8-3bbb00b81654 tempest-DeleteServersTestJSON-245294933 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 16 22:56:18 devstack cinder-volume[81971]: .first() Apr 16 22:56:18 devstack cinder-volume[81971]: Apr 16 22:56:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-3ecd62ce-bccf-42c8-a144-da4fbcbb7f5f req-d235167e-3115-4cd4-abb8-3bbb00b81654 tempest-DeleteServersTestJSON-245294933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-3ecd62ce-bccf-42c8-a144-da4fbcbb7f5f req-d235167e-3115-4cd4-abb8-3bbb00b81654 tempest-DeleteServersTestJSON-245294933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:18 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6081da2-1872-4232-b4fa-b3d2b2fc7e2a]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:56:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-3ecd62ce-bccf-42c8-a144-da4fbcbb7f5f req-d235167e-3115-4cd4-abb8-3bbb00b81654 tempest-DeleteServersTestJSON-245294933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4dccd69f-624c-447d-b1f1-0f81661ff12b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:18 devstack sudo[83023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4dccd69f-624c-447d-b1f1-0f81661ff12b Apr 16 22:56:18 devstack sudo[83023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:19 devstack sudo[83023]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-3ecd62ce-bccf-42c8-a144-da4fbcbb7f5f req-d235167e-3115-4cd4-abb8-3bbb00b81654 tempest-DeleteServersTestJSON-245294933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4dccd69f-624c-447d-b1f1-0f81661ff12b" returned: 0 in 0.582s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-3ecd62ce-bccf-42c8-a144-da4fbcbb7f5f req-d235167e-3115-4cd4-abb8-3bbb00b81654 tempest-DeleteServersTestJSON-245294933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.598s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-3ecd62ce-bccf-42c8-a144-da4fbcbb7f5f req-d235167e-3115-4cd4-abb8-3bbb00b81654 tempest-DeleteServersTestJSON-245294933 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e', 'name': 'volume-4dccd69f-624c-447d-b1f1-0f81661ff12b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84827d81-772f-439a-b0d7-5fc27cbc2615', 'enforce_multipath': True} {{(pid=81971) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 16 22:56:19 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:56:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Flow 'volume_create_manager' (da52fcf8-fb0b-4730-9bd0-00ce4e0662ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:56:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b4c8b8-5c47-4efd-9864-35695b250ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b4c8b8-5c47-4efd-9864-35695b250ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-813741332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=242671cc-8f88-472b-8fa9-7af99e6e1464,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66ff61340124414a938d3a75fa224563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:56:19Z,use_quota=True,user_id='a61554af05c24419a5ed95d0ab4c5c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f118fc6-ea5f-4120-a75e-3e6bd2770762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f118fc6-ea5f-4120-a75e-3e6bd2770762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094a9798-8e87-4850-b5ef-d25050b0d902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094a9798-8e87-4850-b5ef-d25050b0d902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '242671cc-8f88-472b-8fa9-7af99e6e1464', 'volume_name': 'volume-242671cc-8f88-472b-8fa9-7af99e6e1464', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6b55ef-577d-4f94-a46c-0795982a1ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6b55ef-577d-4f94-a46c-0795982a1ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d8198a-5895-49c5-9a0a-2f29038c774a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:19 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Volume 242671cc-8f88-472b-8fa9-7af99e6e1464: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-242671cc-8f88-472b-8fa9-7af99e6e1464', 'volume_size': 1} Apr 16 22:56:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-813741332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=242671cc-8f88-472b-8fa9-7af99e6e1464,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='66ff61340124414a938d3a75fa224563',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:56:19Z,use_quota=True,user_id='a61554af05c24419a5ed95d0ab4c5c2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:56:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Creating volume 242671cc-8f88-472b-8fa9-7af99e6e1464 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:56:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:56:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:56:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:56:19 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:56:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-242671cc-8f88-472b-8fa9-7af99e6e1464 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:19 devstack cinder-volume[81971]: INFO cinder.volume.manager [req-3ecd62ce-bccf-42c8-a144-da4fbcbb7f5f req-d235167e-3115-4cd4-abb8-3bbb00b81654 tempest-DeleteServersTestJSON-245294933 None] attachment_update completed successfully. Apr 16 22:56:19 devstack sudo[83031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-242671cc-8f88-472b-8fa9-7af99e6e1464 1073741824 Apr 16 22:56:19 devstack sudo[83031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:20 devstack sudo[83031]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-242671cc-8f88-472b-8fa9-7af99e6e1464 1073741824" returned: 0 in 0.734s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-242671cc-8f88-472b-8fa9-7af99e6e1464 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:20 devstack sudo[83103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-242671cc-8f88-472b-8fa9-7af99e6e1464 Apr 16 22:56:20 devstack sudo[83103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:20 devstack sudo[83103]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-242671cc-8f88-472b-8fa9-7af99e6e1464" returned: 0 in 0.566s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:20 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:56:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d8198a-5895-49c5-9a0a-2f29038c774a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-242671cc-8f88-472b-8fa9-7af99e6e1464', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80832da4-ab2b-48c6-b4e6-55b3c20a6845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:21 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Volume volume-242671cc-8f88-472b-8fa9-7af99e6e1464 (242671cc-8f88-472b-8fa9-7af99e6e1464): created successfully Apr 16 22:56:21 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80832da4-ab2b-48c6-b4e6-55b3c20a6845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:21 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Flow 'volume_create_manager' (da52fcf8-fb0b-4730-9bd0-00ce4e0662ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:56:21 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-d5c76c9a-c530-43ca-b999-de1df8ef7a91 tempest-VolumesTestJSON-1825858516 None] Created volume successfully. Apr 16 22:56:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e6053cae-836b-4022-a9cb-97a9778bb801 tempest-VolumesTestJSON-1825858516 None] Acquiring lock "cinder-242671cc-8f88-472b-8fa9-7af99e6e1464-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:56:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e6053cae-836b-4022-a9cb-97a9778bb801 tempest-VolumesTestJSON-1825858516 None] Lock "cinder-242671cc-8f88-472b-8fa9-7af99e6e1464-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:56:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e6053cae-836b-4022-a9cb-97a9778bb801 tempest-VolumesTestJSON-1825858516 None] Acquiring lock "cinder-quobyte-242671cc-8f88-472b-8fa9-7af99e6e1464" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:56:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e6053cae-836b-4022-a9cb-97a9778bb801 tempest-VolumesTestJSON-1825858516 None] Lock "cinder-quobyte-242671cc-8f88-472b-8fa9-7af99e6e1464" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:56:22 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1f3023-78c3-4300-b77f-8ba71d4a8a7a]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:56:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e6053cae-836b-4022-a9cb-97a9778bb801 tempest-VolumesTestJSON-1825858516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-242671cc-8f88-472b-8fa9-7af99e6e1464 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:22 devstack sudo[83424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-242671cc-8f88-472b-8fa9-7af99e6e1464 Apr 16 22:56:22 devstack sudo[83424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:23 devstack sudo[83424]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e6053cae-836b-4022-a9cb-97a9778bb801 tempest-VolumesTestJSON-1825858516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-242671cc-8f88-472b-8fa9-7af99e6e1464" returned: 0 in 0.744s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e6053cae-836b-4022-a9cb-97a9778bb801 tempest-VolumesTestJSON-1825858516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-242671cc-8f88-472b-8fa9-7af99e6e1464 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:23 devstack sudo[83429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-242671cc-8f88-472b-8fa9-7af99e6e1464 Apr 16 22:56:23 devstack sudo[83429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:24 devstack sudo[83429]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e6053cae-836b-4022-a9cb-97a9778bb801 tempest-VolumesTestJSON-1825858516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-242671cc-8f88-472b-8fa9-7af99e6e1464" returned: 0 in 0.616s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:24 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e6053cae-836b-4022-a9cb-97a9778bb801 tempest-VolumesTestJSON-1825858516 None] Lock "cinder-quobyte-242671cc-8f88-472b-8fa9-7af99e6e1464" released by "delete_volume" :: held 1.403s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:56:24 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-e6053cae-836b-4022-a9cb-97a9778bb801 tempest-VolumesTestJSON-1825858516 None] Created reservations ['a1dc255b-c8b0-4cec-a430-c5a34aaa689a', '12b02818-e2a4-4eef-9960-af9d188769e7', '2a6e00c2-f814-492e-87c9-3a7627dd245a', 'd0139e37-3217-47fd-bbc1-56369f2a71d0'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:56:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e6053cae-836b-4022-a9cb-97a9778bb801 tempest-VolumesTestJSON-1825858516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e6053cae-836b-4022-a9cb-97a9778bb801 tempest-VolumesTestJSON-1825858516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:24 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e6053cae-836b-4022-a9cb-97a9778bb801 tempest-VolumesTestJSON-1825858516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:56:24 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e6053cae-836b-4022-a9cb-97a9778bb801 tempest-VolumesTestJSON-1825858516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:56:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e6053cae-836b-4022-a9cb-97a9778bb801 tempest-VolumesTestJSON-1825858516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e6053cae-836b-4022-a9cb-97a9778bb801 tempest-VolumesTestJSON-1825858516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:24 devstack sudo[83434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:56:24 devstack sudo[83434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:24 devstack sudo[83434]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e6053cae-836b-4022-a9cb-97a9778bb801 tempest-VolumesTestJSON-1825858516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.461s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:24 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-e6053cae-836b-4022-a9cb-97a9778bb801 tempest-VolumesTestJSON-1825858516 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:56:24 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-e6053cae-836b-4022-a9cb-97a9778bb801 tempest-VolumesTestJSON-1825858516 None] Deleted volume successfully. Apr 16 22:56:24 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e6053cae-836b-4022-a9cb-97a9778bb801 tempest-VolumesTestJSON-1825858516 None] Lock "cinder-242671cc-8f88-472b-8fa9-7af99e6e1464-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:56:24 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d2e9dcfc-0807-47c8-a86e-9c68ec23eebc tempest-VolumesTestJSON-1825858516 None] Acquiring lock "cinder-67bac142-cb6f-4591-a416-5d04da56e5c5-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:56:24 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d2e9dcfc-0807-47c8-a86e-9c68ec23eebc tempest-VolumesTestJSON-1825858516 None] Lock "cinder-67bac142-cb6f-4591-a416-5d04da56e5c5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:56:24 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d2e9dcfc-0807-47c8-a86e-9c68ec23eebc tempest-VolumesTestJSON-1825858516 None] Acquiring lock "cinder-quobyte-67bac142-cb6f-4591-a416-5d04da56e5c5" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:56:24 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d2e9dcfc-0807-47c8-a86e-9c68ec23eebc tempest-VolumesTestJSON-1825858516 None] Lock "cinder-quobyte-67bac142-cb6f-4591-a416-5d04da56e5c5" acquired by "delete_volume" :: waited 0.007s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:56:24 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f012a6-8234-4061-b707-458036856243]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:56:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d2e9dcfc-0807-47c8-a86e-9c68ec23eebc tempest-VolumesTestJSON-1825858516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-67bac142-cb6f-4591-a416-5d04da56e5c5 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:25 devstack sudo[83438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-67bac142-cb6f-4591-a416-5d04da56e5c5 Apr 16 22:56:25 devstack sudo[83438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:25 devstack sudo[83438]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d2e9dcfc-0807-47c8-a86e-9c68ec23eebc tempest-VolumesTestJSON-1825858516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-67bac142-cb6f-4591-a416-5d04da56e5c5" returned: 0 in 0.734s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d2e9dcfc-0807-47c8-a86e-9c68ec23eebc tempest-VolumesTestJSON-1825858516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-67bac142-cb6f-4591-a416-5d04da56e5c5 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:25 devstack sudo[83469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-67bac142-cb6f-4591-a416-5d04da56e5c5 Apr 16 22:56:25 devstack sudo[83469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:26 devstack sudo[83469]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d2e9dcfc-0807-47c8-a86e-9c68ec23eebc tempest-VolumesTestJSON-1825858516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-67bac142-cb6f-4591-a416-5d04da56e5c5" returned: 0 in 0.575s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d2e9dcfc-0807-47c8-a86e-9c68ec23eebc tempest-VolumesTestJSON-1825858516 None] Lock "cinder-quobyte-67bac142-cb6f-4591-a416-5d04da56e5c5" released by "delete_volume" :: held 1.341s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:56:26 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-d2e9dcfc-0807-47c8-a86e-9c68ec23eebc tempest-VolumesTestJSON-1825858516 None] Created reservations ['9bc93f96-8b9b-455d-9b1a-69a423f1570a', '3235f10e-8143-485f-ade7-e5178fbec8ab', '3c36f4be-0787-4c64-9aca-063a59e71331', 'da4329d8-1bcd-4d8b-9abe-ad13790c8620'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:56:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d2e9dcfc-0807-47c8-a86e-9c68ec23eebc tempest-VolumesTestJSON-1825858516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d2e9dcfc-0807-47c8-a86e-9c68ec23eebc tempest-VolumesTestJSON-1825858516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:26 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d2e9dcfc-0807-47c8-a86e-9c68ec23eebc tempest-VolumesTestJSON-1825858516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:56:26 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d2e9dcfc-0807-47c8-a86e-9c68ec23eebc tempest-VolumesTestJSON-1825858516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:56:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d2e9dcfc-0807-47c8-a86e-9c68ec23eebc tempest-VolumesTestJSON-1825858516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d2e9dcfc-0807-47c8-a86e-9c68ec23eebc tempest-VolumesTestJSON-1825858516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:26 devstack sudo[83499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:56:26 devstack sudo[83499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:26 devstack sudo[83499]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d2e9dcfc-0807-47c8-a86e-9c68ec23eebc tempest-VolumesTestJSON-1825858516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.561s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:26 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-d2e9dcfc-0807-47c8-a86e-9c68ec23eebc tempest-VolumesTestJSON-1825858516 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:56:26 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-d2e9dcfc-0807-47c8-a86e-9c68ec23eebc tempest-VolumesTestJSON-1825858516 None] Deleted volume successfully. Apr 16 22:56:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d2e9dcfc-0807-47c8-a86e-9c68ec23eebc tempest-VolumesTestJSON-1825858516 None] Lock "cinder-67bac142-cb6f-4591-a416-5d04da56e5c5-delete_volume" released by "delete_volume" :: held 2.022s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:56:27 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-682adda3-64bf-4eab-8cfb-f051c83f114e tempest-VolumesTestJSON-1825858516 None] Acquiring lock "cinder-2c82c33b-997c-4381-86da-977d3c190edf-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:56:27 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-682adda3-64bf-4eab-8cfb-f051c83f114e tempest-VolumesTestJSON-1825858516 None] Lock "cinder-2c82c33b-997c-4381-86da-977d3c190edf-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:56:27 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-682adda3-64bf-4eab-8cfb-f051c83f114e tempest-VolumesTestJSON-1825858516 None] Acquiring lock "cinder-quobyte-2c82c33b-997c-4381-86da-977d3c190edf" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:56:27 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-682adda3-64bf-4eab-8cfb-f051c83f114e tempest-VolumesTestJSON-1825858516 None] Lock "cinder-quobyte-2c82c33b-997c-4381-86da-977d3c190edf" acquired by "delete_volume" :: waited 0.022s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:56:27 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe131650-baf1-4e99-adc0-d14c5d632274]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:56:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-682adda3-64bf-4eab-8cfb-f051c83f114e tempest-VolumesTestJSON-1825858516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2c82c33b-997c-4381-86da-977d3c190edf {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:27 devstack sudo[83503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2c82c33b-997c-4381-86da-977d3c190edf Apr 16 22:56:27 devstack sudo[83503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:27 devstack sudo[83503]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-682adda3-64bf-4eab-8cfb-f051c83f114e tempest-VolumesTestJSON-1825858516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2c82c33b-997c-4381-86da-977d3c190edf" returned: 0 in 0.699s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-682adda3-64bf-4eab-8cfb-f051c83f114e tempest-VolumesTestJSON-1825858516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2c82c33b-997c-4381-86da-977d3c190edf {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:27 devstack sudo[83512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2c82c33b-997c-4381-86da-977d3c190edf Apr 16 22:56:27 devstack sudo[83512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:28 devstack sudo[83512]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-682adda3-64bf-4eab-8cfb-f051c83f114e tempest-VolumesTestJSON-1825858516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2c82c33b-997c-4381-86da-977d3c190edf" returned: 0 in 0.531s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:28 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-682adda3-64bf-4eab-8cfb-f051c83f114e tempest-VolumesTestJSON-1825858516 None] Lock "cinder-quobyte-2c82c33b-997c-4381-86da-977d3c190edf" released by "delete_volume" :: held 1.261s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:56:28 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-682adda3-64bf-4eab-8cfb-f051c83f114e tempest-VolumesTestJSON-1825858516 None] Created reservations ['d8f11218-08b2-45f4-b39a-2f2b3feb5130', 'deecad09-ae1e-44f0-8b94-d6f3b5889d17', 'c01e05e6-bf08-48ae-ad04-a762c5a37419', '16ba3b45-2f3c-4b12-abab-0ec823ddb60b'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:56:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-682adda3-64bf-4eab-8cfb-f051c83f114e tempest-VolumesTestJSON-1825858516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-682adda3-64bf-4eab-8cfb-f051c83f114e tempest-VolumesTestJSON-1825858516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:28 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-682adda3-64bf-4eab-8cfb-f051c83f114e tempest-VolumesTestJSON-1825858516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:56:28 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-682adda3-64bf-4eab-8cfb-f051c83f114e tempest-VolumesTestJSON-1825858516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:56:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-682adda3-64bf-4eab-8cfb-f051c83f114e tempest-VolumesTestJSON-1825858516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-682adda3-64bf-4eab-8cfb-f051c83f114e tempest-VolumesTestJSON-1825858516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:28 devstack sudo[83515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:56:28 devstack sudo[83515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:28 devstack cinder-volume[81971]: INFO cinder.volume.manager [req-7380fe55-e0da-439c-a4fb-51384953d291 req-fe9fef06-ae29-4d17-81ce-f23f1e957b21 tempest-DeleteServersTestJSON-245294933 None] Terminate volume connection completed successfully. Apr 16 22:56:28 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-7380fe55-e0da-439c-a4fb-51384953d291 req-fe9fef06-ae29-4d17-81ce-f23f1e957b21 tempest-DeleteServersTestJSON-245294933 None] Deleting attachment 84827d81-772f-439a-b0d7-5fc27cbc2615. {{(pid=81971) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 16 22:56:29 devstack sudo[83515]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-682adda3-64bf-4eab-8cfb-f051c83f114e tempest-VolumesTestJSON-1825858516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.520s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:29 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-682adda3-64bf-4eab-8cfb-f051c83f114e tempest-VolumesTestJSON-1825858516 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:56:29 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-682adda3-64bf-4eab-8cfb-f051c83f114e tempest-VolumesTestJSON-1825858516 None] Deleted volume successfully. Apr 16 22:56:29 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-682adda3-64bf-4eab-8cfb-f051c83f114e tempest-VolumesTestJSON-1825858516 None] Lock "cinder-2c82c33b-997c-4381-86da-977d3c190edf-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:56:33 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-dc30001f-cfb2-4927-9825-c409dce57af9 tempest-DeleteServersTestJSON-245294933 None] Acquiring lock "cinder-4dccd69f-624c-447d-b1f1-0f81661ff12b-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:56:33 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-dc30001f-cfb2-4927-9825-c409dce57af9 tempest-DeleteServersTestJSON-245294933 None] Lock "cinder-4dccd69f-624c-447d-b1f1-0f81661ff12b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:56:33 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-dc30001f-cfb2-4927-9825-c409dce57af9 tempest-DeleteServersTestJSON-245294933 None] Acquiring lock "cinder-quobyte-4dccd69f-624c-447d-b1f1-0f81661ff12b" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:56:33 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-dc30001f-cfb2-4927-9825-c409dce57af9 tempest-DeleteServersTestJSON-245294933 None] Lock "cinder-quobyte-4dccd69f-624c-447d-b1f1-0f81661ff12b" acquired by "delete_volume" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:56:33 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a4b274-5976-49fb-b3ff-33e942aa8fcc]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:56:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dc30001f-cfb2-4927-9825-c409dce57af9 tempest-DeleteServersTestJSON-245294933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4dccd69f-624c-447d-b1f1-0f81661ff12b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:33 devstack sudo[83525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4dccd69f-624c-447d-b1f1-0f81661ff12b Apr 16 22:56:33 devstack sudo[83525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:33 devstack sudo[83525]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dc30001f-cfb2-4927-9825-c409dce57af9 tempest-DeleteServersTestJSON-245294933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4dccd69f-624c-447d-b1f1-0f81661ff12b" returned: 0 in 0.566s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dc30001f-cfb2-4927-9825-c409dce57af9 tempest-DeleteServersTestJSON-245294933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4dccd69f-624c-447d-b1f1-0f81661ff12b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:33 devstack sudo[83530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4dccd69f-624c-447d-b1f1-0f81661ff12b Apr 16 22:56:33 devstack sudo[83530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:34 devstack sudo[83530]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dc30001f-cfb2-4927-9825-c409dce57af9 tempest-DeleteServersTestJSON-245294933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4dccd69f-624c-447d-b1f1-0f81661ff12b" returned: 0 in 0.577s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:34 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-dc30001f-cfb2-4927-9825-c409dce57af9 tempest-DeleteServersTestJSON-245294933 None] Lock "cinder-quobyte-4dccd69f-624c-447d-b1f1-0f81661ff12b" released by "delete_volume" :: held 1.168s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:56:34 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-dc30001f-cfb2-4927-9825-c409dce57af9 tempest-DeleteServersTestJSON-245294933 None] Created reservations ['a8f40338-11eb-4620-b014-6d3d4180fc1a', 'd6c14dc2-f5dd-4771-9501-f09316d00a2a', '61d336dd-b418-44ec-af70-0edff02157c8', 'c1edea91-0f01-4d31-964c-8e75e55ae6a2'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:56:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-dc30001f-cfb2-4927-9825-c409dce57af9 tempest-DeleteServersTestJSON-245294933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-dc30001f-cfb2-4927-9825-c409dce57af9 tempest-DeleteServersTestJSON-245294933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:34 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-dc30001f-cfb2-4927-9825-c409dce57af9 tempest-DeleteServersTestJSON-245294933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:56:34 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-dc30001f-cfb2-4927-9825-c409dce57af9 tempest-DeleteServersTestJSON-245294933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:56:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-dc30001f-cfb2-4927-9825-c409dce57af9 tempest-DeleteServersTestJSON-245294933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dc30001f-cfb2-4927-9825-c409dce57af9 tempest-DeleteServersTestJSON-245294933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:34 devstack sudo[83533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:56:34 devstack sudo[83533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:34 devstack sudo[83533]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dc30001f-cfb2-4927-9825-c409dce57af9 tempest-DeleteServersTestJSON-245294933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.504s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:34 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-dc30001f-cfb2-4927-9825-c409dce57af9 tempest-DeleteServersTestJSON-245294933 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:56:34 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-dc30001f-cfb2-4927-9825-c409dce57af9 tempest-DeleteServersTestJSON-245294933 None] Deleted volume successfully. Apr 16 22:56:34 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-dc30001f-cfb2-4927-9825-c409dce57af9 tempest-DeleteServersTestJSON-245294933 None] Lock "cinder-4dccd69f-624c-447d-b1f1-0f81661ff12b-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:56:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1830dc98-7935-45e5-b630-7589c7f29b1a tempest-BackendsCapabilitiesAdminTestsJSON-1384686379 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327690124512, 'free_capacity_gb': 1775.7327690124512, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81971) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 16 22:56:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-08f4a63f-8daa-4a53-aeef-1b67ba6d1e38 tempest-BackendsCapabilitiesAdminTestsJSON-1384686379 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327690124512, 'free_capacity_gb': 1775.7327690124512, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81971) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 16 22:56:42 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:56:42 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Flow 'volume_create_manager' (627153f5-d90d-4bd0-9b0f-5fb8cf76db62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:56:42 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd03b33e-0db2-4d30-aea8-66521e3f28c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:42 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd03b33e-0db2-4d30-aea8-66521e3f28c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1384960590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a1835f-d6a5-462c-80fb-2fb290268037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5db4042de1eb448aad382a530a469ac5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:56:42Z,use_quota=True,user_id='96627c0feaea4ea38fc9a4e1c1fe0e8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:42 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a115ea80-2d21-464b-8777-6effd4ad2626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:42 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a115ea80-2d21-464b-8777-6effd4ad2626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:42 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba3d8d0-a913-427a-9313-0cdbab5026d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:42 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dba3d8d0-a913-427a-9313-0cdbab5026d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9a1835f-d6a5-462c-80fb-2fb290268037', 'volume_name': 'volume-a9a1835f-d6a5-462c-80fb-2fb290268037', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:42 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f300f1-280a-4e5d-ab1e-c4b41fa8cc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:42 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8f300f1-280a-4e5d-ab1e-c4b41fa8cc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:42 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a801ecc-347e-43b5-978d-d05557746154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:42 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Volume a9a1835f-d6a5-462c-80fb-2fb290268037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9a1835f-d6a5-462c-80fb-2fb290268037', 'volume_size': 1} Apr 16 22:56:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:42 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:56:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1384960590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a1835f-d6a5-462c-80fb-2fb290268037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5db4042de1eb448aad382a530a469ac5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:56:42Z,use_quota=True,user_id='96627c0feaea4ea38fc9a4e1c1fe0e8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:56:42 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Creating volume a9a1835f-d6a5-462c-80fb-2fb290268037 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:56:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:42 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:56:42 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:56:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:42 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:56:42 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:56:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a9a1835f-d6a5-462c-80fb-2fb290268037 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:42 devstack sudo[83540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a9a1835f-d6a5-462c-80fb-2fb290268037 1073741824 Apr 16 22:56:42 devstack sudo[83540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:43 devstack sudo[83540]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a9a1835f-d6a5-462c-80fb-2fb290268037 1073741824" returned: 0 in 0.759s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a9a1835f-d6a5-462c-80fb-2fb290268037 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:43 devstack sudo[83545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a9a1835f-d6a5-462c-80fb-2fb290268037 Apr 16 22:56:43 devstack sudo[83545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Flow 'volume_create_manager' (2dae6d89-d6fb-4703-ad10-267724054ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ec8f23-c369-4021-89f6-ed27eb1d1a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47ec8f23-c369-4021-89f6-ed27eb1d1a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2106026054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=426718c9-52ed-441e-8a1d-c721c77a0df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4220b207a22434b9d5cd8813335dd71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:56:44Z,use_quota=True,user_id='3f32ef322576432e9477b34f2899bb86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489a6e84-9482-4386-8827-637156fc1f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489a6e84-9482-4386-8827-637156fc1f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e50e223-debf-431d-87c7-5b4e07976906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e50e223-debf-431d-87c7-5b4e07976906) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '426718c9-52ed-441e-8a1d-c721c77a0df1', 'volume_name': 'volume-426718c9-52ed-441e-8a1d-c721c77a0df1', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531811a6-1453-40a8-adf5-04bdf2c206b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (531811a6-1453-40a8-adf5-04bdf2c206b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:43 devstack sudo[83545]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6273944-2956-41a4-9858-6b178aa7dd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:43 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Volume 426718c9-52ed-441e-8a1d-c721c77a0df1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-426718c9-52ed-441e-8a1d-c721c77a0df1', 'volume_size': 1} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a9a1835f-d6a5-462c-80fb-2fb290268037" returned: 0 in 0.607s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.401s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:56:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-2106026054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=426718c9-52ed-441e-8a1d-c721c77a0df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4220b207a22434b9d5cd8813335dd71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:56:44Z,use_quota=True,user_id='3f32ef322576432e9477b34f2899bb86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Creating volume 426718c9-52ed-441e-8a1d-c721c77a0df1 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:56:43 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-426718c9-52ed-441e-8a1d-c721c77a0df1 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a801ecc-347e-43b5-978d-d05557746154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9a1835f-d6a5-462c-80fb-2fb290268037', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77927cbb-4305-4158-85d8-fd3f214c63b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:43 devstack sudo[83548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-426718c9-52ed-441e-8a1d-c721c77a0df1 1073741824 Apr 16 22:56:43 devstack sudo[83548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:43 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Volume volume-a9a1835f-d6a5-462c-80fb-2fb290268037 (a9a1835f-d6a5-462c-80fb-2fb290268037): created successfully Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77927cbb-4305-4158-85d8-fd3f214c63b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:43 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Flow 'volume_create_manager' (627153f5-d90d-4bd0-9b0f-5fb8cf76db62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:56:43 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-37588855-37e3-4714-b526-8f308f1b7e87 tempest-VolumesMetadataTest-748545301 None] Created volume successfully. Apr 16 22:56:44 devstack sudo[83548]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-426718c9-52ed-441e-8a1d-c721c77a0df1 1073741824" returned: 0 in 0.662s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-426718c9-52ed-441e-8a1d-c721c77a0df1 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:44 devstack sudo[83553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-426718c9-52ed-441e-8a1d-c721c77a0df1 Apr 16 22:56:44 devstack sudo[83553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:45 devstack sudo[83553]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-426718c9-52ed-441e-8a1d-c721c77a0df1" returned: 0 in 0.586s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:45 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] <== create_volume: return (1280ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:56:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.288s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6273944-2956-41a4-9858-6b178aa7dd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-426718c9-52ed-441e-8a1d-c721c77a0df1', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d3564ad-2639-4a59-ae46-37ac80b882de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:45 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Volume volume-426718c9-52ed-441e-8a1d-c721c77a0df1 (426718c9-52ed-441e-8a1d-c721c77a0df1): created successfully Apr 16 22:56:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d3564ad-2639-4a59-ae46-37ac80b882de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Flow 'volume_create_manager' (2dae6d89-d6fb-4703-ad10-267724054ce7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:56:45 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-afad1174-7a2b-4c3c-bc54-f399136a9ad2 tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Created volume successfully. Apr 16 22:56:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-313f1eb1-ec22-40bc-bb13-1e70057d1dbe tempest-VolumesMetadataTest-748545301 None] Acquiring lock "cinder-a9a1835f-d6a5-462c-80fb-2fb290268037-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:56:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-313f1eb1-ec22-40bc-bb13-1e70057d1dbe tempest-VolumesMetadataTest-748545301 None] Lock "cinder-a9a1835f-d6a5-462c-80fb-2fb290268037-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:56:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-313f1eb1-ec22-40bc-bb13-1e70057d1dbe tempest-VolumesMetadataTest-748545301 None] Acquiring lock "cinder-quobyte-a9a1835f-d6a5-462c-80fb-2fb290268037" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:56:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-313f1eb1-ec22-40bc-bb13-1e70057d1dbe tempest-VolumesMetadataTest-748545301 None] Lock "cinder-quobyte-a9a1835f-d6a5-462c-80fb-2fb290268037" acquired by "delete_volume" :: waited 0.027s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:56:45 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba83853-a033-40fa-b6b6-f93d504a5523]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:56:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-313f1eb1-ec22-40bc-bb13-1e70057d1dbe tempest-VolumesMetadataTest-748545301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a9a1835f-d6a5-462c-80fb-2fb290268037 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:45 devstack sudo[83556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a9a1835f-d6a5-462c-80fb-2fb290268037 Apr 16 22:56:45 devstack sudo[83556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:46 devstack sudo[83556]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-313f1eb1-ec22-40bc-bb13-1e70057d1dbe tempest-VolumesMetadataTest-748545301 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a9a1835f-d6a5-462c-80fb-2fb290268037" returned: 0 in 0.587s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-313f1eb1-ec22-40bc-bb13-1e70057d1dbe tempest-VolumesMetadataTest-748545301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a9a1835f-d6a5-462c-80fb-2fb290268037 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:46 devstack sudo[83561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a9a1835f-d6a5-462c-80fb-2fb290268037 Apr 16 22:56:46 devstack sudo[83561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:46 devstack sudo[83561]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-313f1eb1-ec22-40bc-bb13-1e70057d1dbe tempest-VolumesMetadataTest-748545301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a9a1835f-d6a5-462c-80fb-2fb290268037" returned: 0 in 0.544s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-313f1eb1-ec22-40bc-bb13-1e70057d1dbe tempest-VolumesMetadataTest-748545301 None] Lock "cinder-quobyte-a9a1835f-d6a5-462c-80fb-2fb290268037" released by "delete_volume" :: held 1.162s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:56:46 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-313f1eb1-ec22-40bc-bb13-1e70057d1dbe tempest-VolumesMetadataTest-748545301 None] Created reservations ['2ff912b2-93ef-4235-8185-7b934054ce90', '2680fb43-0c06-42ad-898a-1df421ca3024', '80fdd4c6-60a1-4504-8c4b-21d1dc45bcff', 'ca6c81f4-3cd6-429c-b80d-6b8a99312fd1'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:56:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-313f1eb1-ec22-40bc-bb13-1e70057d1dbe tempest-VolumesMetadataTest-748545301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-313f1eb1-ec22-40bc-bb13-1e70057d1dbe tempest-VolumesMetadataTest-748545301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:46 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-313f1eb1-ec22-40bc-bb13-1e70057d1dbe tempest-VolumesMetadataTest-748545301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:56:46 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-313f1eb1-ec22-40bc-bb13-1e70057d1dbe tempest-VolumesMetadataTest-748545301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:56:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-313f1eb1-ec22-40bc-bb13-1e70057d1dbe tempest-VolumesMetadataTest-748545301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-313f1eb1-ec22-40bc-bb13-1e70057d1dbe tempest-VolumesMetadataTest-748545301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:46 devstack sudo[83573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:56:46 devstack sudo[83573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-1459e0a4-57e5-484f-ab18-96ff6e37fc2e tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Acquiring lock "cinder-426718c9-52ed-441e-8a1d-c721c77a0df1-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:56:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-1459e0a4-57e5-484f-ab18-96ff6e37fc2e tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Lock "cinder-426718c9-52ed-441e-8a1d-c721c77a0df1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:56:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-1459e0a4-57e5-484f-ab18-96ff6e37fc2e tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Acquiring lock "cinder-quobyte-426718c9-52ed-441e-8a1d-c721c77a0df1" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:56:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-1459e0a4-57e5-484f-ab18-96ff6e37fc2e tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Lock "cinder-quobyte-426718c9-52ed-441e-8a1d-c721c77a0df1" acquired by "delete_volume" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:56:46 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[f012a982-6b97-4589-b089-88e3fc9874dc]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:56:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1459e0a4-57e5-484f-ab18-96ff6e37fc2e tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-426718c9-52ed-441e-8a1d-c721c77a0df1 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:46 devstack sudo[83576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-426718c9-52ed-441e-8a1d-c721c77a0df1 Apr 16 22:56:46 devstack sudo[83576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:47 devstack sudo[83573]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-313f1eb1-ec22-40bc-bb13-1e70057d1dbe tempest-VolumesMetadataTest-748545301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.471s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:47 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-313f1eb1-ec22-40bc-bb13-1e70057d1dbe tempest-VolumesMetadataTest-748545301 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:56:47 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-313f1eb1-ec22-40bc-bb13-1e70057d1dbe tempest-VolumesMetadataTest-748545301 None] Deleted volume successfully. Apr 16 22:56:47 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-313f1eb1-ec22-40bc-bb13-1e70057d1dbe tempest-VolumesMetadataTest-748545301 None] Lock "cinder-a9a1835f-d6a5-462c-80fb-2fb290268037-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:56:47 devstack sudo[83576]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1459e0a4-57e5-484f-ab18-96ff6e37fc2e tempest-VolumeQuotasNegativeTestJSON-2009856239 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-426718c9-52ed-441e-8a1d-c721c77a0df1" returned: 0 in 0.604s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1459e0a4-57e5-484f-ab18-96ff6e37fc2e tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-426718c9-52ed-441e-8a1d-c721c77a0df1 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:47 devstack sudo[83585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-426718c9-52ed-441e-8a1d-c721c77a0df1 Apr 16 22:56:47 devstack sudo[83585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:47 devstack sudo[83585]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1459e0a4-57e5-484f-ab18-96ff6e37fc2e tempest-VolumeQuotasNegativeTestJSON-2009856239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-426718c9-52ed-441e-8a1d-c721c77a0df1" returned: 0 in 0.507s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:47 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-1459e0a4-57e5-484f-ab18-96ff6e37fc2e tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Lock "cinder-quobyte-426718c9-52ed-441e-8a1d-c721c77a0df1" released by "delete_volume" :: held 1.135s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:56:47 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-1459e0a4-57e5-484f-ab18-96ff6e37fc2e tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Created reservations ['eb1e5230-722d-48c6-83a9-0dfc03591dbd', '52eb3b7d-fcd0-4788-9c99-a14c906b72e8', '1ae61ea4-badd-4ab7-bfea-1eb8f8f8244d', '870db357-a2e1-4d9f-b55f-4dfd6385eb31'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:56:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1459e0a4-57e5-484f-ab18-96ff6e37fc2e tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1459e0a4-57e5-484f-ab18-96ff6e37fc2e tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:48 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-1459e0a4-57e5-484f-ab18-96ff6e37fc2e tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:56:48 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-1459e0a4-57e5-484f-ab18-96ff6e37fc2e tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:56:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1459e0a4-57e5-484f-ab18-96ff6e37fc2e tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1459e0a4-57e5-484f-ab18-96ff6e37fc2e tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:48 devstack sudo[83588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:56:48 devstack sudo[83588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:48 devstack sudo[83588]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1459e0a4-57e5-484f-ab18-96ff6e37fc2e tempest-VolumeQuotasNegativeTestJSON-2009856239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.493s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:48 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-1459e0a4-57e5-484f-ab18-96ff6e37fc2e tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:56:48 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-1459e0a4-57e5-484f-ab18-96ff6e37fc2e tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Deleted volume successfully. Apr 16 22:56:48 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-1459e0a4-57e5-484f-ab18-96ff6e37fc2e tempest-VolumeQuotasNegativeTestJSON-2009856239 None] Lock "cinder-426718c9-52ed-441e-8a1d-c721c77a0df1-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:56:50 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:56:50 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Flow 'volume_create_manager' (97909da0-1f40-46c5-b704-e436d1bcc5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:56:50 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e4aafd-2ffe-4104-9a36-a8fb9b3f6e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:50 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e4aafd-2ffe-4104-9a36-a8fb9b3f6e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1343749067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e8db1a1-9013-4a18-9331-e9cfd7c1913f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa91667ac5c349428400ee03d60986d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:56:51Z,use_quota=True,user_id='52a76ae36ff546f9a9df978e2ee24af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:50 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db236daa-772e-45f3-9c29-c1d719832d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:50 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db236daa-772e-45f3-9c29-c1d719832d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:50 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc16260b-9ee9-4fb4-b4c3-2d14518dac66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:50 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc16260b-9ee9-4fb4-b4c3-2d14518dac66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e8db1a1-9013-4a18-9331-e9cfd7c1913f', 'volume_name': 'volume-8e8db1a1-9013-4a18-9331-e9cfd7c1913f', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:50 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d0ac5d-893d-433a-b91c-27da54a3587b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:50 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70d0ac5d-893d-433a-b91c-27da54a3587b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:51 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd22043a-c40c-4bb8-8c5f-0bdaaeefa563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:51 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Volume 8e8db1a1-9013-4a18-9331-e9cfd7c1913f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e8db1a1-9013-4a18-9331-e9cfd7c1913f', 'volume_size': 1} Apr 16 22:56:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:51 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1343749067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e8db1a1-9013-4a18-9331-e9cfd7c1913f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa91667ac5c349428400ee03d60986d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:56:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:56:51Z,use_quota=True,user_id='52a76ae36ff546f9a9df978e2ee24af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:56:51 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Creating volume 8e8db1a1-9013-4a18-9331-e9cfd7c1913f {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:56:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:51 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:56:51 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:56:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:51 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:56:51 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:56:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-8e8db1a1-9013-4a18-9331-e9cfd7c1913f 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:51 devstack sudo[83592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-8e8db1a1-9013-4a18-9331-e9cfd7c1913f 1073741824 Apr 16 22:56:51 devstack sudo[83592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:51 devstack sudo[83592]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-8e8db1a1-9013-4a18-9331-e9cfd7c1913f 1073741824" returned: 0 in 0.756s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-8e8db1a1-9013-4a18-9331-e9cfd7c1913f {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:51 devstack sudo[83599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-8e8db1a1-9013-4a18-9331-e9cfd7c1913f Apr 16 22:56:51 devstack sudo[83599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:52 devstack sudo[83599]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-8e8db1a1-9013-4a18-9331-e9cfd7c1913f" returned: 0 in 0.687s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:52 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:56:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:52 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd22043a-c40c-4bb8-8c5f-0bdaaeefa563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e8db1a1-9013-4a18-9331-e9cfd7c1913f', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:52 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e66755-c72f-4bfa-aeb5-7985aa2a462f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:52 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Volume volume-8e8db1a1-9013-4a18-9331-e9cfd7c1913f (8e8db1a1-9013-4a18-9331-e9cfd7c1913f): created successfully Apr 16 22:56:52 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e66755-c72f-4bfa-aeb5-7985aa2a462f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:52 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Flow 'volume_create_manager' (97909da0-1f40-46c5-b704-e436d1bcc5fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:56:52 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-6ff6cc16-f23a-4c20-8533-acb5c3c4c1de tempest-VolumesTransfersTest-1265659680 None] Created volume successfully. Apr 16 22:56:53 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:56:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Flow 'volume_create_manager' (4e08b1d1-4c82-440e-a23e-4c2b03624cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:56:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f96c13-db59-49f6-a518-e43e8dfd91ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f96c13-db59-49f6-a518-e43e8dfd91ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1856764091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ad8b6e-2720-4864-98ee-fc141e14c43f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a73a46c5e29f48e6b1958e1b0b41686f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:56:54Z,use_quota=True,user_id='3877620b2d324d92a14dd08b68fe9871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3898c9e7-c7f5-44a2-9939-e0248d3d91b3),volume_type_id=3898c9e7-c7f5-44a2-9939-e0248d3d91b3)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a2f3e7-350d-4d20-95c9-94ea9ff66700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a2f3e7-350d-4d20-95c9-94ea9ff66700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b00efea-5ff1-4254-8612-d63fd23dcf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b00efea-5ff1-4254-8612-d63fd23dcf0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71ad8b6e-2720-4864-98ee-fc141e14c43f', 'volume_name': 'volume-71ad8b6e-2720-4864-98ee-fc141e14c43f', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7a68f6-4a43-485a-9c3d-677fd4217a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f7a68f6-4a43-485a-9c3d-677fd4217a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ca5457-f532-44e3-93a8-919af372af0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:53 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Volume 71ad8b6e-2720-4864-98ee-fc141e14c43f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71ad8b6e-2720-4864-98ee-fc141e14c43f', 'volume_size': 1} Apr 16 22:56:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:53 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1856764091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ad8b6e-2720-4864-98ee-fc141e14c43f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a73a46c5e29f48e6b1958e1b0b41686f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:56:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:56:54Z,use_quota=True,user_id='3877620b2d324d92a14dd08b68fe9871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3898c9e7-c7f5-44a2-9939-e0248d3d91b3),volume_type_id=3898c9e7-c7f5-44a2-9939-e0248d3d91b3)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:56:53 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Creating volume 71ad8b6e-2720-4864-98ee-fc141e14c43f {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:56:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:53 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:56:53 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:56:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:53 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:56:53 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:56:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-71ad8b6e-2720-4864-98ee-fc141e14c43f 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:53 devstack sudo[83620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-71ad8b6e-2720-4864-98ee-fc141e14c43f 1073741824 Apr 16 22:56:53 devstack sudo[83620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:53 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-0873afa8-66d8-4601-912c-5684f5aa5976 tempest-VolumesTransfersTest-1752429247 None] Transfer volume completed successfully. Apr 16 22:56:54 devstack sudo[83620]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-71ad8b6e-2720-4864-98ee-fc141e14c43f 1073741824" returned: 0 in 0.712s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-71ad8b6e-2720-4864-98ee-fc141e14c43f {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:54 devstack sudo[83625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-71ad8b6e-2720-4864-98ee-fc141e14c43f Apr 16 22:56:54 devstack sudo[83625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:54 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-0f1f1544-d2b6-439f-8d15-fc24cf45e304 tempest-VolumesTransfersTest-732622578 None] Acquiring lock "cinder-8e8db1a1-9013-4a18-9331-e9cfd7c1913f-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:56:54 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-0f1f1544-d2b6-439f-8d15-fc24cf45e304 tempest-VolumesTransfersTest-732622578 None] Lock "cinder-8e8db1a1-9013-4a18-9331-e9cfd7c1913f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:56:55 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-0f1f1544-d2b6-439f-8d15-fc24cf45e304 tempest-VolumesTransfersTest-732622578 None] Acquiring lock "cinder-quobyte-8e8db1a1-9013-4a18-9331-e9cfd7c1913f" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:56:55 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-0f1f1544-d2b6-439f-8d15-fc24cf45e304 tempest-VolumesTransfersTest-732622578 None] Lock "cinder-quobyte-8e8db1a1-9013-4a18-9331-e9cfd7c1913f" acquired by "delete_volume" :: waited 0.014s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:56:55 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f6eb98-69e4-41be-b894-6b4fb48715e5]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:56:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0f1f1544-d2b6-439f-8d15-fc24cf45e304 tempest-VolumesTransfersTest-732622578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-8e8db1a1-9013-4a18-9331-e9cfd7c1913f {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:55 devstack sudo[83625]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-71ad8b6e-2720-4864-98ee-fc141e14c43f" returned: 0 in 0.492s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:55 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:56:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ca5457-f532-44e3-93a8-919af372af0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71ad8b6e-2720-4864-98ee-fc141e14c43f', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc44b2f4-2970-4ad6-9433-ce23c5230d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:55 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Volume volume-71ad8b6e-2720-4864-98ee-fc141e14c43f (71ad8b6e-2720-4864-98ee-fc141e14c43f): created successfully Apr 16 22:56:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc44b2f4-2970-4ad6-9433-ce23c5230d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Flow 'volume_create_manager' (4e08b1d1-4c82-440e-a23e-4c2b03624cc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:56:55 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-e63d8153-9d45-4b87-870d-be8a647fea36 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Created volume successfully. Apr 16 22:56:55 devstack sudo[83628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-8e8db1a1-9013-4a18-9331-e9cfd7c1913f Apr 16 22:56:55 devstack sudo[83628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:55 devstack sudo[83628]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0f1f1544-d2b6-439f-8d15-fc24cf45e304 tempest-VolumesTransfersTest-732622578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-8e8db1a1-9013-4a18-9331-e9cfd7c1913f" returned: 0 in 0.507s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0f1f1544-d2b6-439f-8d15-fc24cf45e304 tempest-VolumesTransfersTest-732622578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-8e8db1a1-9013-4a18-9331-e9cfd7c1913f {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:55 devstack sudo[83637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-8e8db1a1-9013-4a18-9331-e9cfd7c1913f Apr 16 22:56:55 devstack sudo[83637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:56 devstack sudo[83637]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0f1f1544-d2b6-439f-8d15-fc24cf45e304 tempest-VolumesTransfersTest-732622578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-8e8db1a1-9013-4a18-9331-e9cfd7c1913f" returned: 0 in 0.475s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:56 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-0f1f1544-d2b6-439f-8d15-fc24cf45e304 tempest-VolumesTransfersTest-732622578 None] Lock "cinder-quobyte-8e8db1a1-9013-4a18-9331-e9cfd7c1913f" released by "delete_volume" :: held 1.017s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:56:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8048631f-433f-465d-b48e-cd2dc69da53f tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8048631f-433f-465d-b48e-cd2dc69da53f tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-8048631f-433f-465d-b48e-cd2dc69da53f tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:56:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-8048631f-433f-465d-b48e-cd2dc69da53f tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:56:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8048631f-433f-465d-b48e-cd2dc69da53f tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8048631f-433f-465d-b48e-cd2dc69da53f tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:56 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-0f1f1544-d2b6-439f-8d15-fc24cf45e304 tempest-VolumesTransfersTest-732622578 None] Created reservations ['82a1804b-848e-4f2f-85cb-3388d4555d6f', '7b4a77fb-1fd2-4d54-a521-7473ba19398d', '2ad489f7-87ba-4138-8cf8-1c898c9a32c1', '54a06c3e-1e7e-4ec9-ada5-954733198eb3'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:56:56 devstack sudo[83643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:56:56 devstack sudo[83643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0f1f1544-d2b6-439f-8d15-fc24cf45e304 tempest-VolumesTransfersTest-732622578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0f1f1544-d2b6-439f-8d15-fc24cf45e304 tempest-VolumesTransfersTest-732622578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-0f1f1544-d2b6-439f-8d15-fc24cf45e304 tempest-VolumesTransfersTest-732622578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:56:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-0f1f1544-d2b6-439f-8d15-fc24cf45e304 tempest-VolumesTransfersTest-732622578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:56:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0f1f1544-d2b6-439f-8d15-fc24cf45e304 tempest-VolumesTransfersTest-732622578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0f1f1544-d2b6-439f-8d15-fc24cf45e304 tempest-VolumesTransfersTest-732622578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:56 devstack sudo[83645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:56:56 devstack sudo[83645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:56 devstack sudo[83643]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8048631f-433f-465d-b48e-cd2dc69da53f tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.462s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:56 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-8048631f-433f-465d-b48e-cd2dc69da53f tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:56:56 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-8048631f-433f-465d-b48e-cd2dc69da53f tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Retype volume completed successfully. Apr 16 22:56:56 devstack sudo[83645]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0f1f1544-d2b6-439f-8d15-fc24cf45e304 tempest-VolumesTransfersTest-732622578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.437s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:56 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-0f1f1544-d2b6-439f-8d15-fc24cf45e304 tempest-VolumesTransfersTest-732622578 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:56:56 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-0f1f1544-d2b6-439f-8d15-fc24cf45e304 tempest-VolumesTransfersTest-732622578 None] Deleted volume successfully. Apr 16 22:56:56 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-0f1f1544-d2b6-439f-8d15-fc24cf45e304 tempest-VolumesTransfersTest-732622578 None] Lock "cinder-8e8db1a1-9013-4a18-9331-e9cfd7c1913f-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-58340aac-6af6-49ed-83b0-754a5e43a661 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Acquiring lock "cinder-71ad8b6e-2720-4864-98ee-fc141e14c43f-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-58340aac-6af6-49ed-83b0-754a5e43a661 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Lock "cinder-71ad8b6e-2720-4864-98ee-fc141e14c43f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Flow 'volume_create_manager' (ab9558dd-3ea3-41bd-8f73-7d382a498ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc179b8-f578-492a-9098-bcb069bc118a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc179b8-f578-492a-9098-bcb069bc118a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-871711255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709237f4-59ac-40b7-9e52-b7d47690b081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa91667ac5c349428400ee03d60986d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:56:57Z,use_quota=True,user_id='52a76ae36ff546f9a9df978e2ee24af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24a72a4-b27b-4bcc-b7af-2912a89e8242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24a72a4-b27b-4bcc-b7af-2912a89e8242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80dd64f1-f136-4d45-9af8-f8a37fe6885f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80dd64f1-f136-4d45-9af8-f8a37fe6885f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '709237f4-59ac-40b7-9e52-b7d47690b081', 'volume_name': 'volume-709237f4-59ac-40b7-9e52-b7d47690b081', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337967df-69a5-4538-adca-c40dafe87b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (337967df-69a5-4538-adca-c40dafe87b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e243f36f-c4d6-4780-b0c0-4f9b8a57855e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:57 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Volume 709237f4-59ac-40b7-9e52-b7d47690b081: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-709237f4-59ac-40b7-9e52-b7d47690b081', 'volume_size': 1} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-871711255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=709237f4-59ac-40b7-9e52-b7d47690b081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa91667ac5c349428400ee03d60986d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:56:57Z,use_quota=True,user_id='52a76ae36ff546f9a9df978e2ee24af7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Creating volume 709237f4-59ac-40b7-9e52-b7d47690b081 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:56:57 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-709237f4-59ac-40b7-9e52-b7d47690b081 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:57 devstack sudo[83686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-709237f4-59ac-40b7-9e52-b7d47690b081 1073741824 Apr 16 22:56:57 devstack sudo[83686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-58340aac-6af6-49ed-83b0-754a5e43a661 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Acquiring lock "cinder-quobyte-71ad8b6e-2720-4864-98ee-fc141e14c43f" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-58340aac-6af6-49ed-83b0-754a5e43a661 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Lock "cinder-quobyte-71ad8b6e-2720-4864-98ee-fc141e14c43f" acquired by "delete_volume" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3bd5bf-0b2f-404e-a7a5-63f6d2386a6f]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:56:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-58340aac-6af6-49ed-83b0-754a5e43a661 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-71ad8b6e-2720-4864-98ee-fc141e14c43f {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:57 devstack sudo[83688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-71ad8b6e-2720-4864-98ee-fc141e14c43f Apr 16 22:56:57 devstack sudo[83688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:58 devstack sudo[83688]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-58340aac-6af6-49ed-83b0-754a5e43a661 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-71ad8b6e-2720-4864-98ee-fc141e14c43f" returned: 0 in 0.468s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-58340aac-6af6-49ed-83b0-754a5e43a661 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-71ad8b6e-2720-4864-98ee-fc141e14c43f {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:58 devstack sudo[83686]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-709237f4-59ac-40b7-9e52-b7d47690b081 1073741824" returned: 0 in 0.545s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:58 devstack sudo[83696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-71ad8b6e-2720-4864-98ee-fc141e14c43f Apr 16 22:56:58 devstack sudo[83696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-709237f4-59ac-40b7-9e52-b7d47690b081 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:58 devstack sudo[83698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-709237f4-59ac-40b7-9e52-b7d47690b081 Apr 16 22:56:58 devstack sudo[83698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:58 devstack sudo[83696]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-58340aac-6af6-49ed-83b0-754a5e43a661 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-71ad8b6e-2720-4864-98ee-fc141e14c43f" returned: 0 in 0.478s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:58 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-58340aac-6af6-49ed-83b0-754a5e43a661 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Lock "cinder-quobyte-71ad8b6e-2720-4864-98ee-fc141e14c43f" released by "delete_volume" :: held 0.985s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:56:58 devstack cinder-volume[81971]: WARNING cinder.quota [None req-58340aac-6af6-49ed-83b0-754a5e43a661 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:56:58 devstack cinder-volume[81971]: WARNING cinder.quota [None req-58340aac-6af6-49ed-83b0-754a5e43a661 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:56:58 devstack sudo[83698]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:58 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-58340aac-6af6-49ed-83b0-754a5e43a661 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Created reservations ['daa4816d-bc72-491d-b43c-234fd79a8f9d', '55484ba9-0447-4ac9-a968-407eb806d433', '14aac382-6920-49ce-b7ec-450018b9e929', 'df79eaa3-2683-433e-8105-679a6d3dda83'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:56:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-709237f4-59ac-40b7-9e52-b7d47690b081" returned: 0 in 0.563s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:58 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:56:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:58 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e243f36f-c4d6-4780-b0c0-4f9b8a57855e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-709237f4-59ac-40b7-9e52-b7d47690b081', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:58 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67482ba-8c3a-499c-a2c0-56cb4e830ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:56:58 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Volume volume-709237f4-59ac-40b7-9e52-b7d47690b081 (709237f4-59ac-40b7-9e52-b7d47690b081): created successfully Apr 16 22:56:58 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67482ba-8c3a-499c-a2c0-56cb4e830ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:56:58 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Flow 'volume_create_manager' (ab9558dd-3ea3-41bd-8f73-7d382a498ef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:56:58 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-cc996782-5dd9-4e14-af64-aa5b7e27b6ec tempest-VolumesTransfersTest-1265659680 None] Created volume successfully. Apr 16 22:56:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-58340aac-6af6-49ed-83b0-754a5e43a661 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:56:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-58340aac-6af6-49ed-83b0-754a5e43a661 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:56:58 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-58340aac-6af6-49ed-83b0-754a5e43a661 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:56:58 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-58340aac-6af6-49ed-83b0-754a5e43a661 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:56:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-58340aac-6af6-49ed-83b0-754a5e43a661 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:56:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-58340aac-6af6-49ed-83b0-754a5e43a661 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:56:58 devstack sudo[83728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:56:58 devstack sudo[83728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:56:59 devstack sudo[83728]: pam_unix(sudo:session): session closed for user root Apr 16 22:56:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-58340aac-6af6-49ed-83b0-754a5e43a661 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.546s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:56:59 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-58340aac-6af6-49ed-83b0-754a5e43a661 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:56:59 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-58340aac-6af6-49ed-83b0-754a5e43a661 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Deleted volume successfully. Apr 16 22:56:59 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-58340aac-6af6-49ed-83b0-754a5e43a661 tempest-VolumeRetypeWithoutMigrationTest-1708387132 None] Lock "cinder-71ad8b6e-2720-4864-98ee-fc141e14c43f-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:57:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-92d9d9eb-dbf2-48ae-b45f-196e78e214bf tempest-VolumesTransfersTest-732622578 None] Acquiring lock "cinder-709237f4-59ac-40b7-9e52-b7d47690b081-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:57:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-92d9d9eb-dbf2-48ae-b45f-196e78e214bf tempest-VolumesTransfersTest-732622578 None] Lock "cinder-709237f4-59ac-40b7-9e52-b7d47690b081-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:57:00 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:SELECT=82,cinder:UPDATE=120,cinder:INSERT=30,cinder:DELETE=11 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:57:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-92d9d9eb-dbf2-48ae-b45f-196e78e214bf tempest-VolumesTransfersTest-732622578 None] Acquiring lock "cinder-quobyte-709237f4-59ac-40b7-9e52-b7d47690b081" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:57:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-92d9d9eb-dbf2-48ae-b45f-196e78e214bf tempest-VolumesTransfersTest-732622578 None] Lock "cinder-quobyte-709237f4-59ac-40b7-9e52-b7d47690b081" acquired by "delete_volume" :: waited 0.027s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:57:00 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf1fd54-bc88-4df9-8033-1c31355931e5]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:57:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-92d9d9eb-dbf2-48ae-b45f-196e78e214bf tempest-VolumesTransfersTest-732622578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-709237f4-59ac-40b7-9e52-b7d47690b081 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:00 devstack sudo[83735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-709237f4-59ac-40b7-9e52-b7d47690b081 Apr 16 22:57:00 devstack sudo[83735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:00 devstack sudo[83735]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-92d9d9eb-dbf2-48ae-b45f-196e78e214bf tempest-VolumesTransfersTest-732622578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-709237f4-59ac-40b7-9e52-b7d47690b081" returned: 0 in 0.637s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-92d9d9eb-dbf2-48ae-b45f-196e78e214bf tempest-VolumesTransfersTest-732622578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-709237f4-59ac-40b7-9e52-b7d47690b081 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:00 devstack sudo[83741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-709237f4-59ac-40b7-9e52-b7d47690b081 Apr 16 22:57:00 devstack sudo[83741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:01 devstack sudo[83741]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-92d9d9eb-dbf2-48ae-b45f-196e78e214bf tempest-VolumesTransfersTest-732622578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-709237f4-59ac-40b7-9e52-b7d47690b081" returned: 0 in 0.539s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:01 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-92d9d9eb-dbf2-48ae-b45f-196e78e214bf tempest-VolumesTransfersTest-732622578 None] Lock "cinder-quobyte-709237f4-59ac-40b7-9e52-b7d47690b081" released by "delete_volume" :: held 1.214s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:57:01 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-92d9d9eb-dbf2-48ae-b45f-196e78e214bf tempest-VolumesTransfersTest-732622578 None] Created reservations ['41ea76e1-5a79-41ee-9b31-3896e2aba5e9', '2d22cd95-c830-468a-96ef-fa1b2871a052', 'da92269b-3fc4-4da1-b591-0c677166a4e9', '3c81a9a0-169b-4459-ad67-8787819e4f4e'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:57:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-92d9d9eb-dbf2-48ae-b45f-196e78e214bf tempest-VolumesTransfersTest-732622578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-92d9d9eb-dbf2-48ae-b45f-196e78e214bf tempest-VolumesTransfersTest-732622578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:01 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d9eb-dbf2-48ae-b45f-196e78e214bf tempest-VolumesTransfersTest-732622578 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:57:01 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-92d9d9eb-dbf2-48ae-b45f-196e78e214bf tempest-VolumesTransfersTest-732622578 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:57:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-92d9d9eb-dbf2-48ae-b45f-196e78e214bf tempest-VolumesTransfersTest-732622578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-92d9d9eb-dbf2-48ae-b45f-196e78e214bf tempest-VolumesTransfersTest-732622578 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:01 devstack sudo[83749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:57:01 devstack sudo[83749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:02 devstack sudo[83749]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-92d9d9eb-dbf2-48ae-b45f-196e78e214bf tempest-VolumesTransfersTest-732622578 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.659s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:02 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-92d9d9eb-dbf2-48ae-b45f-196e78e214bf tempest-VolumesTransfersTest-732622578 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:57:02 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-92d9d9eb-dbf2-48ae-b45f-196e78e214bf tempest-VolumesTransfersTest-732622578 None] Deleted volume successfully. Apr 16 22:57:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-92d9d9eb-dbf2-48ae-b45f-196e78e214bf tempest-VolumesTransfersTest-732622578 None] Lock "cinder-709237f4-59ac-40b7-9e52-b7d47690b081-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:57:04 devstack cinder-volume[81971]: DEBUG oslo_service.periodic_task [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81971) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:57:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:57:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:57:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:04 devstack sudo[83774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:57:04 devstack sudo[83774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:05 devstack sudo[83774]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.554s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:05 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:57:09 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:SELECT=95,cinder:UPDATE=127,cinder:INSERT=21,cinder:DELETE=11 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:57:11 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:57:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Flow 'volume_create_manager' (c54df57f-dbab-4d0d-bd43-484f38e0adf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:57:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d8de19-cad8-4ef6-83fd-65d60d83c9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d8de19-cad8-4ef6-83fd-65d60d83c9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-279246246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e4033a-d572-407e-9be7-e072e8b07669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df5264a94e504f798f51067cc6e62a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:57:11Z,use_quota=True,user_id='7008643c3b634034977d65b2e0135308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6fea39-c7ac-41f5-88f4-2e1611630774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6fea39-c7ac-41f5-88f4-2e1611630774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c149ef-c70b-43b6-9149-c5aaa6e0c39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c149ef-c70b-43b6-9149-c5aaa6e0c39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6e4033a-d572-407e-9be7-e072e8b07669', 'volume_name': 'volume-d6e4033a-d572-407e-9be7-e072e8b07669', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a40aa7-e2b6-4932-97f3-66c9e8166214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a40aa7-e2b6-4932-97f3-66c9e8166214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (268ea2ae-1b81-40dc-9c8e-33da0937023e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:11 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Volume d6e4033a-d572-407e-9be7-e072e8b07669: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6e4033a-d572-407e-9be7-e072e8b07669', 'volume_size': 1} Apr 16 22:57:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:57:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-279246246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e4033a-d572-407e-9be7-e072e8b07669,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df5264a94e504f798f51067cc6e62a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:57:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:57:11Z,use_quota=True,user_id='7008643c3b634034977d65b2e0135308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:57:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Creating volume d6e4033a-d572-407e-9be7-e072e8b07669 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:57:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:57:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:57:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:57:11 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:57:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d6e4033a-d572-407e-9be7-e072e8b07669 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:11 devstack sudo[83826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d6e4033a-d572-407e-9be7-e072e8b07669 1073741824 Apr 16 22:57:11 devstack sudo[83826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:12 devstack sudo[83826]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d6e4033a-d572-407e-9be7-e072e8b07669 1073741824" returned: 0 in 0.973s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d6e4033a-d572-407e-9be7-e072e8b07669 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:12 devstack sudo[83847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d6e4033a-d572-407e-9be7-e072e8b07669 Apr 16 22:57:12 devstack sudo[83847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:13 devstack sudo[83847]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d6e4033a-d572-407e-9be7-e072e8b07669" returned: 0 in 0.643s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] <== create_volume: return (1653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (268ea2ae-1b81-40dc-9c8e-33da0937023e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6e4033a-d572-407e-9be7-e072e8b07669', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a364216b-c6fa-4aa7-b531-4ce3d84810fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:13 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Volume volume-d6e4033a-d572-407e-9be7-e072e8b07669 (d6e4033a-d572-407e-9be7-e072e8b07669): created successfully Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a364216b-c6fa-4aa7-b531-4ce3d84810fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Flow 'volume_create_manager' (c54df57f-dbab-4d0d-bd43-484f38e0adf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:57:13 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-1ff64cb1-f3f4-4ff5-8c50-3e7cf6037048 tempest-VolumesListAdminTestJSON-1777590875 None] Created volume successfully. Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Flow 'volume_create_manager' (e0d56648-3e8d-4bf3-b4da-24a5310a898c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba87ab5e-a825-4a04-81d6-df4e537773c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba87ab5e-a825-4a04-81d6-df4e537773c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1592071211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4e8282-8a8f-4e8a-99f2-498866c37647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df5264a94e504f798f51067cc6e62a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:57:14Z,use_quota=True,user_id='7008643c3b634034977d65b2e0135308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2312aa6a-7a5a-4e56-a768-691d0112d18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2312aa6a-7a5a-4e56-a768-691d0112d18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85686080-2f3c-4e3c-b830-dfd09b282a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85686080-2f3c-4e3c-b830-dfd09b282a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da4e8282-8a8f-4e8a-99f2-498866c37647', 'volume_name': 'volume-da4e8282-8a8f-4e8a-99f2-498866c37647', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f651c957-630f-47e0-956f-7c0277501dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f651c957-630f-47e0-956f-7c0277501dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16685ac-3d5a-4f8f-a9f6-c47e413b5f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:13 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Volume da4e8282-8a8f-4e8a-99f2-498866c37647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da4e8282-8a8f-4e8a-99f2-498866c37647', 'volume_size': 1} Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:57:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1592071211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4e8282-8a8f-4e8a-99f2-498866c37647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df5264a94e504f798f51067cc6e62a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:57:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:57:14Z,use_quota=True,user_id='7008643c3b634034977d65b2e0135308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Creating volume da4e8282-8a8f-4e8a-99f2-498866c37647 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:57:13 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:57:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-da4e8282-8a8f-4e8a-99f2-498866c37647 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:14 devstack sudo[83851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-da4e8282-8a8f-4e8a-99f2-498866c37647 1073741824 Apr 16 22:57:14 devstack sudo[83851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:15 devstack sudo[83851]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-da4e8282-8a8f-4e8a-99f2-498866c37647 1073741824" returned: 0 in 1.413s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-da4e8282-8a8f-4e8a-99f2-498866c37647 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:15 devstack sudo[83866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-da4e8282-8a8f-4e8a-99f2-498866c37647 Apr 16 22:57:15 devstack sudo[83866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:16 devstack sudo[83866]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-da4e8282-8a8f-4e8a-99f2-498866c37647" returned: 0 in 1.154s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:16 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] <== create_volume: return (2646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:57:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.654s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:16 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b16685ac-3d5a-4f8f-a9f6-c47e413b5f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da4e8282-8a8f-4e8a-99f2-498866c37647', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:16 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9a9421-a76b-4e53-a242-706ed5c2b0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:16 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Volume volume-da4e8282-8a8f-4e8a-99f2-498866c37647 (da4e8282-8a8f-4e8a-99f2-498866c37647): created successfully Apr 16 22:57:16 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9a9421-a76b-4e53-a242-706ed5c2b0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:16 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Flow 'volume_create_manager' (e0d56648-3e8d-4bf3-b4da-24a5310a898c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:57:16 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-9abb128a-17eb-4ff9-bc8e-8eeb60f0ac2e tempest-VolumesListAdminTestJSON-1777590875 None] Created volume successfully. Apr 16 22:57:18 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:57:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Flow 'volume_create_manager' (d003ae10-1ea2-4ead-ba9c-7e243c209b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:57:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e7b34dc-7486-4087-80fb-1539622f7ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e7b34dc-7486-4087-80fb-1539622f7ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-289678387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=716f083b-70f3-4a95-af5b-e6cb43279a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df5264a94e504f798f51067cc6e62a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:57:18Z,use_quota=True,user_id='7008643c3b634034977d65b2e0135308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d5d62e-a948-4771-ab9d-c9b53de7c95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d5d62e-a948-4771-ab9d-c9b53de7c95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffba0ca6-84ca-473a-992c-ea14ace8d7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffba0ca6-84ca-473a-992c-ea14ace8d7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '716f083b-70f3-4a95-af5b-e6cb43279a97', 'volume_name': 'volume-716f083b-70f3-4a95-af5b-e6cb43279a97', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caccd8a0-5bfc-47dd-bd49-e934cb95d7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caccd8a0-5bfc-47dd-bd49-e934cb95d7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399311d1-15b3-47e1-83fb-133dd83164f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:18 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Volume 716f083b-70f3-4a95-af5b-e6cb43279a97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-716f083b-70f3-4a95-af5b-e6cb43279a97', 'volume_size': 1} Apr 16 22:57:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:18 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-289678387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=716f083b-70f3-4a95-af5b-e6cb43279a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df5264a94e504f798f51067cc6e62a00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:57:18Z,use_quota=True,user_id='7008643c3b634034977d65b2e0135308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:57:18 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Creating volume 716f083b-70f3-4a95-af5b-e6cb43279a97 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:57:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:18 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:57:18 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:57:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:18 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:57:18 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:57:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-716f083b-70f3-4a95-af5b-e6cb43279a97 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:18 devstack sudo[83923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-716f083b-70f3-4a95-af5b-e6cb43279a97 1073741824 Apr 16 22:57:18 devstack sudo[83923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:19 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:57:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Flow 'volume_create_manager' (8eb40ab9-135b-4c96-8686-ece27b943ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:57:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539b8aba-27d8-45d0-bca4-3612bd7eb6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (539b8aba-27d8-45d0-bca4-3612bd7eb6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-820183647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57104bb9-81ac-49ad-802f-92c92256ccc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b30a4c04e0b8473fb850912b39b67f8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:57:20Z,use_quota=True,user_id='349cd00bbe75456dae6a5ae55e7eb89d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6771ed73-dc5d-447f-b683-71324215b755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6771ed73-dc5d-447f-b683-71324215b755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (831cb220-455d-4e49-8ea9-47b1b7c47260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (831cb220-455d-4e49-8ea9-47b1b7c47260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57104bb9-81ac-49ad-802f-92c92256ccc0', 'volume_name': 'volume-57104bb9-81ac-49ad-802f-92c92256ccc0', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a111805-ad80-4d7b-a434-e24b1082f457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a111805-ad80-4d7b-a434-e24b1082f457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a057628d-c426-418d-bdd1-edf1dfb2fa53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:19 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Volume 57104bb9-81ac-49ad-802f-92c92256ccc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57104bb9-81ac-49ad-802f-92c92256ccc0', 'volume_size': 1} Apr 16 22:57:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:20 devstack sudo[83923]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-716f083b-70f3-4a95-af5b-e6cb43279a97 1073741824" returned: 0 in 1.712s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-716f083b-70f3-4a95-af5b-e6cb43279a97 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:20 devstack sudo[83938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-716f083b-70f3-4a95-af5b-e6cb43279a97 Apr 16 22:57:20 devstack sudo[83938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:21 devstack sudo[83938]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-716f083b-70f3-4a95-af5b-e6cb43279a97" returned: 0 in 0.890s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] <== create_volume: return (2687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:57:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.692s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.080s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-820183647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57104bb9-81ac-49ad-802f-92c92256ccc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b30a4c04e0b8473fb850912b39b67f8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:57:20Z,use_quota=True,user_id='349cd00bbe75456dae6a5ae55e7eb89d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:57:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Creating volume 57104bb9-81ac-49ad-802f-92c92256ccc0 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:57:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:57:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:57:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:57:21 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:57:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:21 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (399311d1-15b3-47e1-83fb-133dd83164f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-716f083b-70f3-4a95-af5b-e6cb43279a97', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:21 devstack sudo[83961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 1073741824 Apr 16 22:57:21 devstack sudo[83961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:21 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d299a906-eb7a-4ff9-9a5b-f6a7daa17f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:21 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Volume volume-716f083b-70f3-4a95-af5b-e6cb43279a97 (716f083b-70f3-4a95-af5b-e6cb43279a97): created successfully Apr 16 22:57:21 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d299a906-eb7a-4ff9-9a5b-f6a7daa17f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:21 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Flow 'volume_create_manager' (d003ae10-1ea2-4ead-ba9c-7e243c209b4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:57:21 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-85f845db-dbbd-4be1-8db5-a5f716bd9924 tempest-VolumesListAdminTestJSON-1777590875 None] Created volume successfully. Apr 16 22:57:22 devstack sudo[83961]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 1073741824" returned: 0 in 1.050s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:22 devstack sudo[83968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 Apr 16 22:57:22 devstack sudo[83968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Flow 'volume_create_manager' (0e7ff236-f93a-4922-84fd-6bf145a50681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a3b12a-5fb9-45ae-9585-e1a1c661dfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a3b12a-5fb9-45ae-9585-e1a1c661dfc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca983fe-2790-4e66-9762-0fe9456db382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b9b23586d54331bcf0db9b5588d73d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:57:22Z,use_quota=True,user_id='f0daf286842f45ad82e35136f01e8584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a9e4155-3f4c-4d79-946f-9d8da9a36482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a9e4155-3f4c-4d79-946f-9d8da9a36482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2efbb09-dc1d-4dcb-b734-1d96ac5205f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2efbb09-dc1d-4dcb-b734-1d96ac5205f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ca983fe-2790-4e66-9762-0fe9456db382', 'volume_name': 'volume-7ca983fe-2790-4e66-9762-0fe9456db382', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb07eebe-7a26-4546-8096-ffe255c0b8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb07eebe-7a26-4546-8096-ffe255c0b8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ffe8a6-a587-410e-9888-a93c62067c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:22 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Volume 7ca983fe-2790-4e66-9762-0fe9456db382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ca983fe-2790-4e66-9762-0fe9456db382', 'volume_size': 1} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:22 devstack sudo[83968]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0" returned: 0 in 0.733s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.832s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.594s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca983fe-2790-4e66-9762-0fe9456db382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b9b23586d54331bcf0db9b5588d73d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:57:22Z,use_quota=True,user_id='f0daf286842f45ad82e35136f01e8584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Creating volume 7ca983fe-2790-4e66-9762-0fe9456db382 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:57:22 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7ca983fe-2790-4e66-9762-0fe9456db382 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a057628d-c426-418d-bdd1-edf1dfb2fa53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57104bb9-81ac-49ad-802f-92c92256ccc0', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65408d4-b25d-482b-9e9a-4c4ac6ebe519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:22 devstack sudo[83977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7ca983fe-2790-4e66-9762-0fe9456db382 1073741824 Apr 16 22:57:22 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Volume volume-57104bb9-81ac-49ad-802f-92c92256ccc0 (57104bb9-81ac-49ad-802f-92c92256ccc0): created successfully Apr 16 22:57:22 devstack sudo[83977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65408d4-b25d-482b-9e9a-4c4ac6ebe519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Flow 'volume_create_manager' (8eb40ab9-135b-4c96-8686-ece27b943ae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:57:22 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-ce61120e-8ac1-4656-ab5f-9977c8406eec tempest-VolumesActionsTest-148448383 None] Created volume successfully. Apr 16 22:57:23 devstack sudo[83977]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7ca983fe-2790-4e66-9762-0fe9456db382 1073741824" returned: 0 in 0.902s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7ca983fe-2790-4e66-9762-0fe9456db382 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:23 devstack sudo[83989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7ca983fe-2790-4e66-9762-0fe9456db382 Apr 16 22:57:23 devstack sudo[83989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:24 devstack sudo[83989]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7ca983fe-2790-4e66-9762-0fe9456db382" returned: 0 in 0.595s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:24 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] <== create_volume: return (1535ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:57:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:24 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ffe8a6-a587-410e-9888-a93c62067c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ca983fe-2790-4e66-9762-0fe9456db382', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:24 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc5725be-db46-44b7-aa34-7dc5595376c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:24 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Volume volume-7ca983fe-2790-4e66-9762-0fe9456db382 (7ca983fe-2790-4e66-9762-0fe9456db382): created successfully Apr 16 22:57:24 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc5725be-db46-44b7-aa34-7dc5595376c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:24 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Flow 'volume_create_manager' (0e7ff236-f93a-4922-84fd-6bf145a50681) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:57:24 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-ca6d35ee-a4ae-4c24-aa6b-be96e26ed1d4 tempest-VolumesListAdminTestJSON-851584030 None] Created volume successfully. Apr 16 22:57:25 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b662ecc7-2173-492e-af9d-158fc3a50eb8 tempest-VolumesListAdminTestJSON-851584030 None] Acquiring lock "cinder-7ca983fe-2790-4e66-9762-0fe9456db382-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:57:25 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b662ecc7-2173-492e-af9d-158fc3a50eb8 tempest-VolumesListAdminTestJSON-851584030 None] Lock "cinder-7ca983fe-2790-4e66-9762-0fe9456db382-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:57:25 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b662ecc7-2173-492e-af9d-158fc3a50eb8 tempest-VolumesListAdminTestJSON-851584030 None] Acquiring lock "cinder-quobyte-7ca983fe-2790-4e66-9762-0fe9456db382" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:57:25 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b662ecc7-2173-492e-af9d-158fc3a50eb8 tempest-VolumesListAdminTestJSON-851584030 None] Lock "cinder-quobyte-7ca983fe-2790-4e66-9762-0fe9456db382" acquired by "delete_volume" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:57:25 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd4c6bb-aaef-4155-b092-0662216f8289]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:57:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b662ecc7-2173-492e-af9d-158fc3a50eb8 tempest-VolumesListAdminTestJSON-851584030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7ca983fe-2790-4e66-9762-0fe9456db382 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:25 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3e627ded-1832-4880-a573-1f772075692c tempest-VolumesListAdminTestJSON-1777590875 None] Acquiring lock "cinder-716f083b-70f3-4a95-af5b-e6cb43279a97-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:57:25 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3e627ded-1832-4880-a573-1f772075692c tempest-VolumesListAdminTestJSON-1777590875 None] Lock "cinder-716f083b-70f3-4a95-af5b-e6cb43279a97-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:57:25 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3e627ded-1832-4880-a573-1f772075692c tempest-VolumesListAdminTestJSON-1777590875 None] Acquiring lock "cinder-quobyte-716f083b-70f3-4a95-af5b-e6cb43279a97" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:57:25 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3e627ded-1832-4880-a573-1f772075692c tempest-VolumesListAdminTestJSON-1777590875 None] Lock "cinder-quobyte-716f083b-70f3-4a95-af5b-e6cb43279a97" acquired by "delete_volume" :: waited 0.023s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:57:25 devstack sudo[84015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7ca983fe-2790-4e66-9762-0fe9456db382 Apr 16 22:57:25 devstack sudo[84015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:25 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19c21ac-972d-4005-9988-e7461e5cefac]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:57:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e627ded-1832-4880-a573-1f772075692c tempest-VolumesListAdminTestJSON-1777590875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-716f083b-70f3-4a95-af5b-e6cb43279a97 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:25 devstack sudo[84017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-716f083b-70f3-4a95-af5b-e6cb43279a97 Apr 16 22:57:25 devstack sudo[84017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:26 devstack sudo[84015]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b662ecc7-2173-492e-af9d-158fc3a50eb8 tempest-VolumesListAdminTestJSON-851584030 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7ca983fe-2790-4e66-9762-0fe9456db382" returned: 0 in 0.970s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b662ecc7-2173-492e-af9d-158fc3a50eb8 tempest-VolumesListAdminTestJSON-851584030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7ca983fe-2790-4e66-9762-0fe9456db382 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:26 devstack sudo[84024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7ca983fe-2790-4e66-9762-0fe9456db382 Apr 16 22:57:26 devstack sudo[84024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:26 devstack sudo[84017]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e627ded-1832-4880-a573-1f772075692c tempest-VolumesListAdminTestJSON-1777590875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-716f083b-70f3-4a95-af5b-e6cb43279a97" returned: 0 in 1.034s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e627ded-1832-4880-a573-1f772075692c tempest-VolumesListAdminTestJSON-1777590875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-716f083b-70f3-4a95-af5b-e6cb43279a97 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:26 devstack sudo[84027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-716f083b-70f3-4a95-af5b-e6cb43279a97 Apr 16 22:57:26 devstack sudo[84027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:26 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:57:26 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Flow 'volume_create_manager' (3183bbea-2004-4619-bbba-1407f18eae80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:57:26 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b92482d-ec18-426b-87d5-df8b24f22e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:26 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b92482d-ec18-426b-87d5-df8b24f22e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-459361119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed16099f-6ec8-4131-a80a-f8c6c08b38ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b74ebc6d744ec2a4f7e4067c9c70bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:57:27Z,use_quota=True,user_id='0d4c4446daa74cfea166a8b6a054fe83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:26 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c6e9ed-640c-45fd-9e94-4d48cd08d1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:26 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c6e9ed-640c-45fd-9e94-4d48cd08d1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5e009c-1107-402d-88e8-616db7d0eb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f5e009c-1107-402d-88e8-616db7d0eb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed16099f-6ec8-4131-a80a-f8c6c08b38ff', 'volume_name': 'volume-ed16099f-6ec8-4131-a80a-f8c6c08b38ff', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (763bc037-0970-4a40-b2d9-b57e8f03e541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (763bc037-0970-4a40-b2d9-b57e8f03e541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ded262e-b6a5-4f32-8f91-698089f70160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:27 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Volume ed16099f-6ec8-4131-a80a-f8c6c08b38ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed16099f-6ec8-4131-a80a-f8c6c08b38ff', 'volume_size': 1} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-459361119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed16099f-6ec8-4131-a80a-f8c6c08b38ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b74ebc6d744ec2a4f7e4067c9c70bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:57:27Z,use_quota=True,user_id='0d4c4446daa74cfea166a8b6a054fe83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Creating volume ed16099f-6ec8-4131-a80a-f8c6c08b38ff {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:57:27 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ed16099f-6ec8-4131-a80a-f8c6c08b38ff 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:27 devstack sudo[84029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ed16099f-6ec8-4131-a80a-f8c6c08b38ff 1073741824 Apr 16 22:57:27 devstack sudo[84029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:27 devstack sudo[84027]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e627ded-1832-4880-a573-1f772075692c tempest-VolumesListAdminTestJSON-1777590875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-716f083b-70f3-4a95-af5b-e6cb43279a97" returned: 0 in 0.658s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3e627ded-1832-4880-a573-1f772075692c tempest-VolumesListAdminTestJSON-1777590875 None] Lock "cinder-quobyte-716f083b-70f3-4a95-af5b-e6cb43279a97" released by "delete_volume" :: held 1.757s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-3e627ded-1832-4880-a573-1f772075692c tempest-VolumesListAdminTestJSON-1777590875 None] Created reservations ['185b1232-c4db-4e52-aad3-6cc91170edb3', '6e80dbff-00d2-49d6-97d5-177d115db643', 'a3fb62b5-000d-4047-8a7a-07610eafa2e6', 'bb03dfc2-9834-407c-8ae7-8fb2743ab4dc'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:57:27 devstack sudo[84024]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b662ecc7-2173-492e-af9d-158fc3a50eb8 tempest-VolumesListAdminTestJSON-851584030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7ca983fe-2790-4e66-9762-0fe9456db382" returned: 0 in 1.028s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b662ecc7-2173-492e-af9d-158fc3a50eb8 tempest-VolumesListAdminTestJSON-851584030 None] Lock "cinder-quobyte-7ca983fe-2790-4e66-9762-0fe9456db382" released by "delete_volume" :: held 2.073s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3e627ded-1832-4880-a573-1f772075692c tempest-VolumesListAdminTestJSON-1777590875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3e627ded-1832-4880-a573-1f772075692c tempest-VolumesListAdminTestJSON-1777590875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3e627ded-1832-4880-a573-1f772075692c tempest-VolumesListAdminTestJSON-1777590875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3e627ded-1832-4880-a573-1f772075692c tempest-VolumesListAdminTestJSON-1777590875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3e627ded-1832-4880-a573-1f772075692c tempest-VolumesListAdminTestJSON-1777590875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e627ded-1832-4880-a573-1f772075692c tempest-VolumesListAdminTestJSON-1777590875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-b662ecc7-2173-492e-af9d-158fc3a50eb8 tempest-VolumesListAdminTestJSON-851584030 None] Created reservations ['488750dd-1d72-415e-9d6b-df94853ba8e5', '1f94d8ff-6e5b-4b71-b43a-d9961d611e9c', 'c9d02a35-ba22-4f83-9129-e87d9b0962fe', '52649762-f66e-4a37-a335-6c9abdceabed'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:57:27 devstack sudo[84035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:57:27 devstack sudo[84035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b662ecc7-2173-492e-af9d-158fc3a50eb8 tempest-VolumesListAdminTestJSON-851584030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b662ecc7-2173-492e-af9d-158fc3a50eb8 tempest-VolumesListAdminTestJSON-851584030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b662ecc7-2173-492e-af9d-158fc3a50eb8 tempest-VolumesListAdminTestJSON-851584030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b662ecc7-2173-492e-af9d-158fc3a50eb8 tempest-VolumesListAdminTestJSON-851584030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b662ecc7-2173-492e-af9d-158fc3a50eb8 tempest-VolumesListAdminTestJSON-851584030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b662ecc7-2173-492e-af9d-158fc3a50eb8 tempest-VolumesListAdminTestJSON-851584030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:27 devstack sudo[84037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:57:27 devstack sudo[84037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:28 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3fcbdfb6-bad6-4ef1-9910-dc3a9ecce7e4 tempest-VolumesListAdminTestJSON-1777590875 None] Acquiring lock "cinder-da4e8282-8a8f-4e8a-99f2-498866c37647-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:57:28 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3fcbdfb6-bad6-4ef1-9910-dc3a9ecce7e4 tempest-VolumesListAdminTestJSON-1777590875 None] Lock "cinder-da4e8282-8a8f-4e8a-99f2-498866c37647-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:57:28 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3fcbdfb6-bad6-4ef1-9910-dc3a9ecce7e4 tempest-VolumesListAdminTestJSON-1777590875 None] Acquiring lock "cinder-quobyte-da4e8282-8a8f-4e8a-99f2-498866c37647" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:57:28 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3fcbdfb6-bad6-4ef1-9910-dc3a9ecce7e4 tempest-VolumesListAdminTestJSON-1777590875 None] Lock "cinder-quobyte-da4e8282-8a8f-4e8a-99f2-498866c37647" acquired by "delete_volume" :: waited 0.020s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:57:28 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[5922b06a-d7be-42d5-88cd-a9149bcabbcd]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:57:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3fcbdfb6-bad6-4ef1-9910-dc3a9ecce7e4 tempest-VolumesListAdminTestJSON-1777590875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-da4e8282-8a8f-4e8a-99f2-498866c37647 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:28 devstack sudo[84042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-da4e8282-8a8f-4e8a-99f2-498866c37647 Apr 16 22:57:28 devstack sudo[84042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:28 devstack sudo[84029]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ed16099f-6ec8-4131-a80a-f8c6c08b38ff 1073741824" returned: 0 in 1.535s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ed16099f-6ec8-4131-a80a-f8c6c08b38ff {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:28 devstack sudo[84045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ed16099f-6ec8-4131-a80a-f8c6c08b38ff Apr 16 22:57:28 devstack sudo[84045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:28 devstack sudo[84037]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b662ecc7-2173-492e-af9d-158fc3a50eb8 tempest-VolumesListAdminTestJSON-851584030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 1.098s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:28 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-b662ecc7-2173-492e-af9d-158fc3a50eb8 tempest-VolumesListAdminTestJSON-851584030 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:57:28 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-b662ecc7-2173-492e-af9d-158fc3a50eb8 tempest-VolumesListAdminTestJSON-851584030 None] Deleted volume successfully. Apr 16 22:57:28 devstack sudo[84035]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:28 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b662ecc7-2173-492e-af9d-158fc3a50eb8 tempest-VolumesListAdminTestJSON-851584030 None] Lock "cinder-7ca983fe-2790-4e66-9762-0fe9456db382-delete_volume" released by "delete_volume" :: held 3.484s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:57:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e627ded-1832-4880-a573-1f772075692c tempest-VolumesListAdminTestJSON-1777590875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 1.290s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:28 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-3e627ded-1832-4880-a573-1f772075692c tempest-VolumesListAdminTestJSON-1777590875 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:57:28 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-3e627ded-1832-4880-a573-1f772075692c tempest-VolumesListAdminTestJSON-1777590875 None] Deleted volume successfully. Apr 16 22:57:28 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3e627ded-1832-4880-a573-1f772075692c tempest-VolumesListAdminTestJSON-1777590875 None] Lock "cinder-716f083b-70f3-4a95-af5b-e6cb43279a97-delete_volume" released by "delete_volume" :: held 3.340s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:57:29 devstack sudo[84042]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3fcbdfb6-bad6-4ef1-9910-dc3a9ecce7e4 tempest-VolumesListAdminTestJSON-1777590875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-da4e8282-8a8f-4e8a-99f2-498866c37647" returned: 0 in 1.585s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3fcbdfb6-bad6-4ef1-9910-dc3a9ecce7e4 tempest-VolumesListAdminTestJSON-1777590875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-da4e8282-8a8f-4e8a-99f2-498866c37647 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:29 devstack sudo[84045]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ed16099f-6ec8-4131-a80a-f8c6c08b38ff" returned: 0 in 1.155s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:29 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] <== create_volume: return (2744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:57:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.748s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:29 devstack sudo[84053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-da4e8282-8a8f-4e8a-99f2-498866c37647 Apr 16 22:57:29 devstack sudo[84053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ded262e-b6a5-4f32-8f91-698089f70160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed16099f-6ec8-4131-a80a-f8c6c08b38ff', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad9c194-d196-4458-b33d-be2fb97abf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:29 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Volume volume-ed16099f-6ec8-4131-a80a-f8c6c08b38ff (ed16099f-6ec8-4131-a80a-f8c6c08b38ff): created successfully Apr 16 22:57:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad9c194-d196-4458-b33d-be2fb97abf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Flow 'volume_create_manager' (3183bbea-2004-4619-bbba-1407f18eae80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:57:29 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-0e80c873-5768-4501-87b1-894e7d3eeab3 tempest-ServersNegativeTestJSON-1096885395 None] Created volume successfully. Apr 16 22:57:29 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:57:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Flow 'volume_create_manager' (d25ee0cf-0ff2-4808-8e10-42de938d33ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:57:30 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7145de3-2921-473e-9ced-a6f737828f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:30 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7145de3-2921-473e-9ced-a6f737828f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:57:29Z,deleted=False,deleted_at=None,display_description='',display_name='4bd9532c-3700-41e1-950f-28c4d270e82e-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d94658-23e2-4065-8176-c7f022f9200f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f387930380394a13a1dce51e052b4c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:57:30Z,use_quota=True,user_id='d0f6a64aba2841608a6df0569904d699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:30 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (043ee94a-28ef-4123-8fdf-1a1b695feb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:30 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (043ee94a-28ef-4123-8fdf-1a1b695feb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:30 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede6aabf-701b-438a-9dca-e3514b35e174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:30 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ede6aabf-701b-438a-9dca-e3514b35e174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8d94658-23e2-4065-8176-c7f022f9200f', 'volume_name': 'volume-d8d94658-23e2-4065-8176-c7f022f9200f', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:30 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e76931-1ea9-45e3-8853-bac51de54fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:30 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e76931-1ea9-45e3-8853-bac51de54fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:30 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87f92f7-d2bf-40d6-8f30-612604c7da8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:30 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Volume d8d94658-23e2-4065-8176-c7f022f9200f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8d94658-23e2-4065-8176-c7f022f9200f', 'volume_size': 1} Apr 16 22:57:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:30 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:57:29Z,deleted=False,deleted_at=None,display_description='',display_name='4bd9532c-3700-41e1-950f-28c4d270e82e-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d94658-23e2-4065-8176-c7f022f9200f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f387930380394a13a1dce51e052b4c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:57:30Z,use_quota=True,user_id='d0f6a64aba2841608a6df0569904d699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:57:30 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Creating volume d8d94658-23e2-4065-8176-c7f022f9200f {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:57:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:30 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:57:30 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:57:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:30 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:57:30 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:57:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d8d94658-23e2-4065-8176-c7f022f9200f 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:30 devstack sudo[84055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d8d94658-23e2-4065-8176-c7f022f9200f 1073741824 Apr 16 22:57:30 devstack sudo[84055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:30 devstack sudo[84053]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3fcbdfb6-bad6-4ef1-9910-dc3a9ecce7e4 tempest-VolumesListAdminTestJSON-1777590875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-da4e8282-8a8f-4e8a-99f2-498866c37647" returned: 0 in 1.197s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:30 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3fcbdfb6-bad6-4ef1-9910-dc3a9ecce7e4 tempest-VolumesListAdminTestJSON-1777590875 None] Lock "cinder-quobyte-da4e8282-8a8f-4e8a-99f2-498866c37647" released by "delete_volume" :: held 2.860s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:57:31 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-3fcbdfb6-bad6-4ef1-9910-dc3a9ecce7e4 tempest-VolumesListAdminTestJSON-1777590875 None] Created reservations ['016b1c8d-3321-4b0f-8006-5a0dfe1f4dce', '55fe99f6-e2c7-4fac-b332-08bf3da41d14', '1f804cac-bbb1-46cf-b394-8e37125b79d5', '87059ac3-5ad9-4970-a851-c443dceae6b0'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:57:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3fcbdfb6-bad6-4ef1-9910-dc3a9ecce7e4 tempest-VolumesListAdminTestJSON-1777590875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3fcbdfb6-bad6-4ef1-9910-dc3a9ecce7e4 tempest-VolumesListAdminTestJSON-1777590875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:31 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3fcbdfb6-bad6-4ef1-9910-dc3a9ecce7e4 tempest-VolumesListAdminTestJSON-1777590875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:57:31 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3fcbdfb6-bad6-4ef1-9910-dc3a9ecce7e4 tempest-VolumesListAdminTestJSON-1777590875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:57:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3fcbdfb6-bad6-4ef1-9910-dc3a9ecce7e4 tempest-VolumesListAdminTestJSON-1777590875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3fcbdfb6-bad6-4ef1-9910-dc3a9ecce7e4 tempest-VolumesListAdminTestJSON-1777590875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:31 devstack sudo[84060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:57:31 devstack sudo[84060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:31 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-06bf7afe-e9a5-4fbd-adf0-49b5c40925ff tempest-VolumesListAdminTestJSON-1777590875 None] Acquiring lock "cinder-d6e4033a-d572-407e-9be7-e072e8b07669-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:57:31 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-06bf7afe-e9a5-4fbd-adf0-49b5c40925ff tempest-VolumesListAdminTestJSON-1777590875 None] Lock "cinder-d6e4033a-d572-407e-9be7-e072e8b07669-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:57:31 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-06bf7afe-e9a5-4fbd-adf0-49b5c40925ff tempest-VolumesListAdminTestJSON-1777590875 None] Acquiring lock "cinder-quobyte-d6e4033a-d572-407e-9be7-e072e8b07669" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:57:31 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-06bf7afe-e9a5-4fbd-adf0-49b5c40925ff tempest-VolumesListAdminTestJSON-1777590875 None] Lock "cinder-quobyte-d6e4033a-d572-407e-9be7-e072e8b07669" acquired by "delete_volume" :: waited 0.029s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:57:31 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd66633-0f8a-4cd5-bca3-502f677d6c1a]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:57:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-06bf7afe-e9a5-4fbd-adf0-49b5c40925ff tempest-VolumesListAdminTestJSON-1777590875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d6e4033a-d572-407e-9be7-e072e8b07669 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:32 devstack sudo[84055]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d8d94658-23e2-4065-8176-c7f022f9200f 1073741824" returned: 0 in 1.979s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:32 devstack sudo[84070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d6e4033a-d572-407e-9be7-e072e8b07669 Apr 16 22:57:32 devstack sudo[84070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d8d94658-23e2-4065-8176-c7f022f9200f {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:32 devstack sudo[84076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d8d94658-23e2-4065-8176-c7f022f9200f Apr 16 22:57:32 devstack sudo[84076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:32 devstack sudo[84060]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3fcbdfb6-bad6-4ef1-9910-dc3a9ecce7e4 tempest-VolumesListAdminTestJSON-1777590875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 1.259s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:32 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-3fcbdfb6-bad6-4ef1-9910-dc3a9ecce7e4 tempest-VolumesListAdminTestJSON-1777590875 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:57:32 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-3fcbdfb6-bad6-4ef1-9910-dc3a9ecce7e4 tempest-VolumesListAdminTestJSON-1777590875 None] Deleted volume successfully. Apr 16 22:57:32 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3fcbdfb6-bad6-4ef1-9910-dc3a9ecce7e4 tempest-VolumesListAdminTestJSON-1777590875 None] Lock "cinder-da4e8282-8a8f-4e8a-99f2-498866c37647-delete_volume" released by "delete_volume" :: held 4.374s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:57:33 devstack sudo[84070]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-06bf7afe-e9a5-4fbd-adf0-49b5c40925ff tempest-VolumesListAdminTestJSON-1777590875 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d6e4033a-d572-407e-9be7-e072e8b07669" returned: 0 in 1.545s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-06bf7afe-e9a5-4fbd-adf0-49b5c40925ff tempest-VolumesListAdminTestJSON-1777590875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d6e4033a-d572-407e-9be7-e072e8b07669 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Flow 'volume_create_manager' (9a5e91da-f591-4f33-9bff-fc3d8bd52867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:57:33 devstack sudo[84090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d6e4033a-d572-407e-9be7-e072e8b07669 Apr 16 22:57:33 devstack sudo[84090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0584b617-062b-495d-a687-d91caf0139b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0584b617-062b-495d-a687-d91caf0139b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1571072164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b74ebc6d744ec2a4f7e4067c9c70bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:57:33Z,use_quota=True,user_id='0d4c4446daa74cfea166a8b6a054fe83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0083749c-2431-4ca3-881c-291b4bc92b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0083749c-2431-4ca3-881c-291b4bc92b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6950fb29-88fa-4a5e-88b7-6ab277833ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6950fb29-88fa-4a5e-88b7-6ab277833ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5', 'volume_name': 'volume-1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60164ac-e66f-4484-a55c-e824cf6faf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b60164ac-e66f-4484-a55c-e824cf6faf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ab8292a-db3a-4851-b02b-69e983a59611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:33 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Volume 1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5', 'volume_size': 1} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:33 devstack sudo[84076]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d8d94658-23e2-4065-8176-c7f022f9200f" returned: 0 in 1.671s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] <== create_volume: return (3707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.710s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.132s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1571072164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b74ebc6d744ec2a4f7e4067c9c70bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:57:33Z,use_quota=True,user_id='0d4c4446daa74cfea166a8b6a054fe83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Creating volume 1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:57:33 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a87f92f7-d2bf-40d6-8f30-612604c7da8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8d94658-23e2-4065-8176-c7f022f9200f', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4396f091-79bf-4d59-8483-ed2be50dbc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:33 devstack sudo[84095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5 1073741824 Apr 16 22:57:33 devstack sudo[84095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:33 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Volume volume-d8d94658-23e2-4065-8176-c7f022f9200f (d8d94658-23e2-4065-8176-c7f022f9200f): created successfully Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4396f091-79bf-4d59-8483-ed2be50dbc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Flow 'volume_create_manager' (d25ee0cf-0ff2-4808-8e10-42de938d33ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:57:33 devstack cinder-volume[81971]: INFO cinder.volume.manager [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-12b61809-0628-4aa2-9085-c6879bf4d685 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Created volume successfully. Apr 16 22:57:34 devstack sudo[84090]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-06bf7afe-e9a5-4fbd-adf0-49b5c40925ff tempest-VolumesListAdminTestJSON-1777590875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d6e4033a-d572-407e-9be7-e072e8b07669" returned: 0 in 0.865s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:34 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-06bf7afe-e9a5-4fbd-adf0-49b5c40925ff tempest-VolumesListAdminTestJSON-1777590875 None] Lock "cinder-quobyte-d6e4033a-d572-407e-9be7-e072e8b07669" released by "delete_volume" :: held 2.498s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:57:34 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-06bf7afe-e9a5-4fbd-adf0-49b5c40925ff tempest-VolumesListAdminTestJSON-1777590875 None] Created reservations ['f62964a8-d27e-47c9-bdb6-4d0702b204b5', '9c09f83c-be93-433d-895c-a017b21a41cd', '1df9f48b-5ee0-4c81-aeb8-8800d781356c', '1a631822-b846-4048-b0ef-64b8514bd9e2'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:57:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-06bf7afe-e9a5-4fbd-adf0-49b5c40925ff tempest-VolumesListAdminTestJSON-1777590875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-06bf7afe-e9a5-4fbd-adf0-49b5c40925ff tempest-VolumesListAdminTestJSON-1777590875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:34 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-06bf7afe-e9a5-4fbd-adf0-49b5c40925ff tempest-VolumesListAdminTestJSON-1777590875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:57:34 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-06bf7afe-e9a5-4fbd-adf0-49b5c40925ff tempest-VolumesListAdminTestJSON-1777590875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:57:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-06bf7afe-e9a5-4fbd-adf0-49b5c40925ff tempest-VolumesListAdminTestJSON-1777590875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-06bf7afe-e9a5-4fbd-adf0-49b5c40925ff tempest-VolumesListAdminTestJSON-1777590875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:34 devstack sudo[84102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:57:34 devstack sudo[84102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:34 devstack sudo[84095]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5 1073741824" returned: 0 in 0.791s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:34 devstack sudo[84104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5 Apr 16 22:57:34 devstack sudo[84104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:35 devstack sudo[84102]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-06bf7afe-e9a5-4fbd-adf0-49b5c40925ff tempest-VolumesListAdminTestJSON-1777590875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 1.034s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:35 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-06bf7afe-e9a5-4fbd-adf0-49b5c40925ff tempest-VolumesListAdminTestJSON-1777590875 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:57:35 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-06bf7afe-e9a5-4fbd-adf0-49b5c40925ff tempest-VolumesListAdminTestJSON-1777590875 None] Deleted volume successfully. Apr 16 22:57:35 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-06bf7afe-e9a5-4fbd-adf0-49b5c40925ff tempest-VolumesListAdminTestJSON-1777590875 None] Lock "cinder-d6e4033a-d572-407e-9be7-e072e8b07669-delete_volume" released by "delete_volume" :: held 3.722s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:57:35 devstack sudo[84104]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5" returned: 0 in 1.046s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:57:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ab8292a-db3a-4851-b02b-69e983a59611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8061b0b1-387e-47b1-88ed-6b6007793eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:35 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Volume volume-1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5 (1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5): created successfully Apr 16 22:57:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8061b0b1-387e-47b1-88ed-6b6007793eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Flow 'volume_create_manager' (9a5e91da-f591-4f33-9bff-fc3d8bd52867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:57:35 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-47b9b464-075a-45ec-b954-bb5da2000a79 tempest-ServersNegativeTestJSON-1096885395 None] Created volume successfully. Apr 16 22:57:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-0e44f805-6a20-4270-bd8a-426178e4fbe6 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-0e44f805-6a20-4270-bd8a-426178e4fbe6 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:36 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3e0212-7726-46e2-b3bc-09111f8eb4b0]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:57:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-0e44f805-6a20-4270-bd8a-426178e4fbe6 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d8d94658-23e2-4065-8176-c7f022f9200f {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:36 devstack sudo[84120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d8d94658-23e2-4065-8176-c7f022f9200f Apr 16 22:57:36 devstack sudo[84120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:37 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-86ae2e21-f6c7-4a9a-adb9-23c1a345c4d6 tempest-ServersNegativeTestJSON-1096885395 None] Acquiring lock "cinder-1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:57:37 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-86ae2e21-f6c7-4a9a-adb9-23c1a345c4d6 tempest-ServersNegativeTestJSON-1096885395 None] Lock "cinder-1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:57:37 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-86ae2e21-f6c7-4a9a-adb9-23c1a345c4d6 tempest-ServersNegativeTestJSON-1096885395 None] Acquiring lock "cinder-quobyte-1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:57:37 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-86ae2e21-f6c7-4a9a-adb9-23c1a345c4d6 tempest-ServersNegativeTestJSON-1096885395 None] Lock "cinder-quobyte-1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5" acquired by "delete_volume" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:57:37 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cc4bc1-92d4-4d69-802c-7412e182d3cc]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:57:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-86ae2e21-f6c7-4a9a-adb9-23c1a345c4d6 tempest-ServersNegativeTestJSON-1096885395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:37 devstack sudo[84126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5 Apr 16 22:57:37 devstack sudo[84126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:37 devstack sudo[84120]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-0e44f805-6a20-4270-bd8a-426178e4fbe6 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d8d94658-23e2-4065-8176-c7f022f9200f" returned: 0 in 0.912s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-0e44f805-6a20-4270-bd8a-426178e4fbe6 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.958s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-0e44f805-6a20-4270-bd8a-426178e4fbe6 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e', 'name': 'volume-d8d94658-23e2-4065-8176-c7f022f9200f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5a781bb1-8bc2-4eea-93a9-8be5e19ee460', 'enforce_multipath': True} {{(pid=81971) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 16 22:57:37 devstack cinder-volume[81971]: INFO cinder.volume.manager [req-b6c35c52-4bc5-4436-b5c1-298a3252437a req-0e44f805-6a20-4270-bd8a-426178e4fbe6 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] attachment_update completed successfully. Apr 16 22:57:38 devstack sudo[84126]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-86ae2e21-f6c7-4a9a-adb9-23c1a345c4d6 tempest-ServersNegativeTestJSON-1096885395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5" returned: 0 in 0.766s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-86ae2e21-f6c7-4a9a-adb9-23c1a345c4d6 tempest-ServersNegativeTestJSON-1096885395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:38 devstack sudo[84172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5 Apr 16 22:57:38 devstack sudo[84172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:38 devstack sudo[84172]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-86ae2e21-f6c7-4a9a-adb9-23c1a345c4d6 tempest-ServersNegativeTestJSON-1096885395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5" returned: 0 in 0.505s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:38 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-86ae2e21-f6c7-4a9a-adb9-23c1a345c4d6 tempest-ServersNegativeTestJSON-1096885395 None] Lock "cinder-quobyte-1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5" released by "delete_volume" :: held 1.297s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:57:38 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-86ae2e21-f6c7-4a9a-adb9-23c1a345c4d6 tempest-ServersNegativeTestJSON-1096885395 None] Created reservations ['e99dc1f8-ca2e-4701-a96f-0d89916cf481', 'a49bb3c6-3a44-42b6-9a8d-fafc1145d0b4', 'd414ddad-5a4c-4d14-8389-fae3d2b2e620', '7ef49772-5759-42bd-a53c-aec0fea3f220'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:57:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-86ae2e21-f6c7-4a9a-adb9-23c1a345c4d6 tempest-ServersNegativeTestJSON-1096885395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-86ae2e21-f6c7-4a9a-adb9-23c1a345c4d6 tempest-ServersNegativeTestJSON-1096885395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:38 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-86ae2e21-f6c7-4a9a-adb9-23c1a345c4d6 tempest-ServersNegativeTestJSON-1096885395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:57:38 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-86ae2e21-f6c7-4a9a-adb9-23c1a345c4d6 tempest-ServersNegativeTestJSON-1096885395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:57:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-86ae2e21-f6c7-4a9a-adb9-23c1a345c4d6 tempest-ServersNegativeTestJSON-1096885395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-86ae2e21-f6c7-4a9a-adb9-23c1a345c4d6 tempest-ServersNegativeTestJSON-1096885395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:38 devstack sudo[84175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:57:38 devstack sudo[84175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:39 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-721df5c6-c090-430b-baf3-a088dd50a52a tempest-ServersNegativeTestJSON-1096885395 None] Acquiring lock "cinder-ed16099f-6ec8-4131-a80a-f8c6c08b38ff-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:57:39 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-721df5c6-c090-430b-baf3-a088dd50a52a tempest-ServersNegativeTestJSON-1096885395 None] Lock "cinder-ed16099f-6ec8-4131-a80a-f8c6c08b38ff-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:57:39 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-721df5c6-c090-430b-baf3-a088dd50a52a tempest-ServersNegativeTestJSON-1096885395 None] Acquiring lock "cinder-quobyte-ed16099f-6ec8-4131-a80a-f8c6c08b38ff" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:57:39 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-721df5c6-c090-430b-baf3-a088dd50a52a tempest-ServersNegativeTestJSON-1096885395 None] Lock "cinder-quobyte-ed16099f-6ec8-4131-a80a-f8c6c08b38ff" acquired by "delete_volume" :: waited 0.019s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:57:39 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[712c77b9-6ba9-43e4-90c9-62386bc443ae]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:57:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-721df5c6-c090-430b-baf3-a088dd50a52a tempest-ServersNegativeTestJSON-1096885395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ed16099f-6ec8-4131-a80a-f8c6c08b38ff {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:39 devstack sudo[84175]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-86ae2e21-f6c7-4a9a-adb9-23c1a345c4d6 tempest-ServersNegativeTestJSON-1096885395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 1.053s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:39 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-86ae2e21-f6c7-4a9a-adb9-23c1a345c4d6 tempest-ServersNegativeTestJSON-1096885395 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:57:39 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-86ae2e21-f6c7-4a9a-adb9-23c1a345c4d6 tempest-ServersNegativeTestJSON-1096885395 None] Deleted volume successfully. Apr 16 22:57:39 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-86ae2e21-f6c7-4a9a-adb9-23c1a345c4d6 tempest-ServersNegativeTestJSON-1096885395 None] Lock "cinder-1a6f4aa7-b3ee-472f-bb7a-2c31a9c67dc5-delete_volume" released by "delete_volume" :: held 2.562s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:57:39 devstack sudo[84204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ed16099f-6ec8-4131-a80a-f8c6c08b38ff Apr 16 22:57:39 devstack sudo[84204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:40 devstack sudo[84204]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-721df5c6-c090-430b-baf3-a088dd50a52a tempest-ServersNegativeTestJSON-1096885395 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ed16099f-6ec8-4131-a80a-f8c6c08b38ff" returned: 0 in 0.978s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-721df5c6-c090-430b-baf3-a088dd50a52a tempest-ServersNegativeTestJSON-1096885395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ed16099f-6ec8-4131-a80a-f8c6c08b38ff {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:40 devstack sudo[84278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ed16099f-6ec8-4131-a80a-f8c6c08b38ff Apr 16 22:57:40 devstack sudo[84278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:41 devstack sudo[84278]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-721df5c6-c090-430b-baf3-a088dd50a52a tempest-ServersNegativeTestJSON-1096885395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ed16099f-6ec8-4131-a80a-f8c6c08b38ff" returned: 0 in 0.640s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:41 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-721df5c6-c090-430b-baf3-a088dd50a52a tempest-ServersNegativeTestJSON-1096885395 None] Lock "cinder-quobyte-ed16099f-6ec8-4131-a80a-f8c6c08b38ff" released by "delete_volume" :: held 1.669s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:57:41 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-721df5c6-c090-430b-baf3-a088dd50a52a tempest-ServersNegativeTestJSON-1096885395 None] Created reservations ['ec23aeb1-e03c-4b12-a0fc-19a6c613d09e', '360992a2-4f71-4583-94b9-2cfb53af17e0', '20a94d69-d07b-4edf-97bc-ce106b3a6c41', '97878a81-3b4c-4303-ad4b-4efba035e3f0'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:57:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-721df5c6-c090-430b-baf3-a088dd50a52a tempest-ServersNegativeTestJSON-1096885395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-721df5c6-c090-430b-baf3-a088dd50a52a tempest-ServersNegativeTestJSON-1096885395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:41 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-721df5c6-c090-430b-baf3-a088dd50a52a tempest-ServersNegativeTestJSON-1096885395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:57:41 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-721df5c6-c090-430b-baf3-a088dd50a52a tempest-ServersNegativeTestJSON-1096885395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:57:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-721df5c6-c090-430b-baf3-a088dd50a52a tempest-ServersNegativeTestJSON-1096885395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-721df5c6-c090-430b-baf3-a088dd50a52a tempest-ServersNegativeTestJSON-1096885395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:41 devstack sudo[84285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:57:41 devstack sudo[84285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:41 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c64a74f3-17aa-475f-83dc-b8ddd4ea88d3 tempest-VolumesActionsTest-148448383 None] Acquiring lock "cinder-57104bb9-81ac-49ad-802f-92c92256ccc0" by "attach_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:57:41 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c64a74f3-17aa-475f-83dc-b8ddd4ea88d3 tempest-VolumesActionsTest-148448383 None] Lock "cinder-57104bb9-81ac-49ad-802f-92c92256ccc0" acquired by "attach_volume" :: waited 0.039s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:57:41 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-c64a74f3-17aa-475f-83dc-b8ddd4ea88d3 tempest-VolumesActionsTest-148448383 None] Attaching volume 57104bb9-81ac-49ad-802f-92c92256ccc0 to instance 15ebd223-a956-473b-8773-d5764b4ace33 at mountpoint /dev/vdb on host None. Apr 16 22:57:41 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-c64a74f3-17aa-475f-83dc-b8ddd4ea88d3 tempest-VolumesActionsTest-148448383 None] Attach volume completed successfully. Apr 16 22:57:41 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c64a74f3-17aa-475f-83dc-b8ddd4ea88d3 tempest-VolumesActionsTest-148448383 None] Lock "cinder-57104bb9-81ac-49ad-802f-92c92256ccc0" released by "attach_volume" :: held 0.231s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:57:42 devstack sudo[84285]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:42 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c0d2f34e-92be-4f65-a80e-40eb7bcc76a2 tempest-VolumesActionsTest-148448383 None] Acquiring lock "cinder-57104bb9-81ac-49ad-802f-92c92256ccc0-detach_volume" by "detach_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:57:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-721df5c6-c090-430b-baf3-a088dd50a52a tempest-ServersNegativeTestJSON-1096885395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 1.115s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:42 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-721df5c6-c090-430b-baf3-a088dd50a52a tempest-ServersNegativeTestJSON-1096885395 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:57:42 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-721df5c6-c090-430b-baf3-a088dd50a52a tempest-ServersNegativeTestJSON-1096885395 None] Deleted volume successfully. Apr 16 22:57:42 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c0d2f34e-92be-4f65-a80e-40eb7bcc76a2 tempest-VolumesActionsTest-148448383 None] Lock "cinder-57104bb9-81ac-49ad-802f-92c92256ccc0-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:57:42 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-c0d2f34e-92be-4f65-a80e-40eb7bcc76a2 tempest-VolumesActionsTest-148448383 None] Detaching volume 57104bb9-81ac-49ad-802f-92c92256ccc0 from instance 15ebd223-a956-473b-8773-d5764b4ace33. Apr 16 22:57:42 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-721df5c6-c090-430b-baf3-a088dd50a52a tempest-ServersNegativeTestJSON-1096885395 None] Lock "cinder-ed16099f-6ec8-4131-a80a-f8c6c08b38ff-delete_volume" released by "delete_volume" :: held 3.059s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:57:42 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-c0d2f34e-92be-4f65-a80e-40eb7bcc76a2 tempest-VolumesActionsTest-148448383 None] Detach volume completed successfully. Apr 16 22:57:42 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c0d2f34e-92be-4f65-a80e-40eb7bcc76a2 tempest-VolumesActionsTest-148448383 None] Lock "cinder-57104bb9-81ac-49ad-802f-92c92256ccc0-detach_volume" released by "detach_volume" :: held 0.089s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:57:46 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:57:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Flow 'volume_create_manager' (7795520b-4f2f-4b52-8099-bb5f0ff959ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:57:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5e3fa95-52c0-4905-a2aa-105d0ca72e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5e3fa95-52c0-4905-a2aa-105d0ca72e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1175395549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=483db631-eaa0-404f-b4c8-e5b611ed3376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9c3d3c76ce47ceacbd9bc81ace89be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:57:46Z,use_quota=True,user_id='a36284610b944f4ebb352b422670a84d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1944d2f8-8a6e-4b04-996d-4a8f10ac924d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1944d2f8-8a6e-4b04-996d-4a8f10ac924d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c36515e-ce6a-43a8-87dd-3053189d4205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c36515e-ce6a-43a8-87dd-3053189d4205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '483db631-eaa0-404f-b4c8-e5b611ed3376', 'volume_name': 'volume-483db631-eaa0-404f-b4c8-e5b611ed3376', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b43b67a-d026-4c48-bceb-5965b5143d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b43b67a-d026-4c48-bceb-5965b5143d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67251da2-746f-4f95-abeb-5b78bf7e214c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:46 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Volume 483db631-eaa0-404f-b4c8-e5b611ed3376: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-483db631-eaa0-404f-b4c8-e5b611ed3376', 'volume_size': 1} Apr 16 22:57:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:46 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1175395549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=483db631-eaa0-404f-b4c8-e5b611ed3376,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a9c3d3c76ce47ceacbd9bc81ace89be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:57:46Z,use_quota=True,user_id='a36284610b944f4ebb352b422670a84d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:57:46 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Creating volume 483db631-eaa0-404f-b4c8-e5b611ed3376 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:57:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:46 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:57:46 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:57:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:46 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:57:46 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:57:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:46 devstack sudo[84677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376 1073741824 Apr 16 22:57:46 devstack sudo[84677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:46 devstack sudo[84677]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376 1073741824" returned: 0 in 0.714s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:46 devstack sudo[84691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376 Apr 16 22:57:46 devstack sudo[84691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:47 devstack sudo[84691]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376" returned: 0 in 0.568s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:47 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:57:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67251da2-746f-4f95-abeb-5b78bf7e214c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-483db631-eaa0-404f-b4c8-e5b611ed3376', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c15e87d-1cae-4afc-be94-5b651f9573a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:47 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Volume volume-483db631-eaa0-404f-b4c8-e5b611ed3376 (483db631-eaa0-404f-b4c8-e5b611ed3376): created successfully Apr 16 22:57:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c15e87d-1cae-4afc-be94-5b651f9573a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Flow 'volume_create_manager' (7795520b-4f2f-4b52-8099-bb5f0ff959ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:57:47 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-72be97f0-2b8d-4155-ae3e-a4cf28ea8ad4 tempest-SnapshotMetadataTestJSON-2009965371 None] Created volume successfully. Apr 16 22:57:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-7848dc74-2fb2-4c0b-a287-e778fe9353bb tempest-SnapshotMetadataTestJSON-2009965371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-7848dc74-2fb2-4c0b-a287-e778fe9353bb tempest-SnapshotMetadataTestJSON-2009965371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:48 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-7848dc74-2fb2-4c0b-a287-e778fe9353bb tempest-SnapshotMetadataTestJSON-2009965371 None] Creating offline snapshot bd63253f-a5e7-4688-b951-26cab49b4990 of volume 483db631-eaa0-404f-b4c8-e5b611ed3376 {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:57:48 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a17ee02-7ac7-4f5c-9a27-760c70ec056c]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:57:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7848dc74-2fb2-4c0b-a287-e778fe9353bb tempest-SnapshotMetadataTestJSON-2009965371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:48 devstack sudo[84695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376 Apr 16 22:57:48 devstack sudo[84695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:48 devstack sudo[84695]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7848dc74-2fb2-4c0b-a287-e778fe9353bb tempest-SnapshotMetadataTestJSON-2009965371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376" returned: 0 in 0.575s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7848dc74-2fb2-4c0b-a287-e778fe9353bb tempest-SnapshotMetadataTestJSON-2009965371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.bd63253f-a5e7-4688-b951-26cab49b4990 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:49 devstack sudo[84700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.bd63253f-a5e7-4688-b951-26cab49b4990 1G Apr 16 22:57:49 devstack sudo[84700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:49 devstack sudo[84700]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7848dc74-2fb2-4c0b-a287-e778fe9353bb tempest-SnapshotMetadataTestJSON-2009965371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.bd63253f-a5e7-4688-b951-26cab49b4990 1G" returned: 0 in 0.593s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7848dc74-2fb2-4c0b-a287-e778fe9353bb tempest-SnapshotMetadataTestJSON-2009965371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-483db631-eaa0-404f-b4c8-e5b611ed3376 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.bd63253f-a5e7-4688-b951-26cab49b4990 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:49 devstack sudo[84705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-483db631-eaa0-404f-b4c8-e5b611ed3376 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.bd63253f-a5e7-4688-b951-26cab49b4990 Apr 16 22:57:49 devstack sudo[84705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:50 devstack sudo[84705]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7848dc74-2fb2-4c0b-a287-e778fe9353bb tempest-SnapshotMetadataTestJSON-2009965371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-483db631-eaa0-404f-b4c8-e5b611ed3376 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.bd63253f-a5e7-4688-b951-26cab49b4990" returned: 0 in 0.483s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:50 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-7848dc74-2fb2-4c0b-a287-e778fe9353bb tempest-SnapshotMetadataTestJSON-2009965371 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.bd63253f-a5e7-4688-b951-26cab49b4990 is being set with open permissions: ugo+rw Apr 16 22:57:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7848dc74-2fb2-4c0b-a287-e778fe9353bb tempest-SnapshotMetadataTestJSON-2009965371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.bd63253f-a5e7-4688-b951-26cab49b4990 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:50 devstack sudo[84710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.bd63253f-a5e7-4688-b951-26cab49b4990 Apr 16 22:57:50 devstack sudo[84710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:50 devstack sudo[84710]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7848dc74-2fb2-4c0b-a287-e778fe9353bb tempest-SnapshotMetadataTestJSON-2009965371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.bd63253f-a5e7-4688-b951-26cab49b4990" returned: 0 in 0.552s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7848dc74-2fb2-4c0b-a287-e778fe9353bb tempest-SnapshotMetadataTestJSON-2009965371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:50 devstack sudo[84714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.info Apr 16 22:57:50 devstack sudo[84714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:51 devstack sudo[84714]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7848dc74-2fb2-4c0b-a287-e778fe9353bb tempest-SnapshotMetadataTestJSON-2009965371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.info" returned: 0 in 0.617s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:51 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-7848dc74-2fb2-4c0b-a287-e778fe9353bb tempest-SnapshotMetadataTestJSON-2009965371 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.info is being set with open permissions: ugo+rw Apr 16 22:57:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7848dc74-2fb2-4c0b-a287-e778fe9353bb tempest-SnapshotMetadataTestJSON-2009965371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:51 devstack sudo[84745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.info Apr 16 22:57:51 devstack sudo[84745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:51 devstack sudo[84745]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7848dc74-2fb2-4c0b-a287-e778fe9353bb tempest-SnapshotMetadataTestJSON-2009965371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.info" returned: 0 in 0.479s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-7848dc74-2fb2-4c0b-a287-e778fe9353bb tempest-SnapshotMetadataTestJSON-2009965371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.376s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:51 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-7848dc74-2fb2-4c0b-a287-e778fe9353bb tempest-SnapshotMetadataTestJSON-2009965371 None] Create snapshot completed successfully Apr 16 22:57:53 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b55404ca-f6be-4277-8856-53e6e85e4a92 tempest-SnapshotMetadataTestJSON-2009965371 None] Acquiring lock "cinder-bd63253f-a5e7-4688-b951-26cab49b4990-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:57:53 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b55404ca-f6be-4277-8856-53e6e85e4a92 tempest-SnapshotMetadataTestJSON-2009965371 None] Lock "cinder-bd63253f-a5e7-4688-b951-26cab49b4990-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:57:53 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b55404ca-f6be-4277-8856-53e6e85e4a92 tempest-SnapshotMetadataTestJSON-2009965371 None] Acquiring lock "cinder-quobyte-483db631-eaa0-404f-b4c8-e5b611ed3376" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:57:53 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b55404ca-f6be-4277-8856-53e6e85e4a92 tempest-SnapshotMetadataTestJSON-2009965371 None] Lock "cinder-quobyte-483db631-eaa0-404f-b4c8-e5b611ed3376" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:57:53 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b55404ca-f6be-4277-8856-53e6e85e4a92 tempest-SnapshotMetadataTestJSON-2009965371 None] Acquiring lock "cinder-quobyte-bd63253f-a5e7-4688-b951-26cab49b4990" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:57:53 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b55404ca-f6be-4277-8856-53e6e85e4a92 tempest-SnapshotMetadataTestJSON-2009965371 None] Lock "cinder-quobyte-bd63253f-a5e7-4688-b951-26cab49b4990" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:57:53 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-b55404ca-f6be-4277-8856-53e6e85e4a92 tempest-SnapshotMetadataTestJSON-2009965371 None] Deleting offline snapshot bd63253f-a5e7-4688-b951-26cab49b4990 of volume 483db631-eaa0-404f-b4c8-e5b611ed3376 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:57:53 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-b55404ca-f6be-4277-8856-53e6e85e4a92 tempest-SnapshotMetadataTestJSON-2009965371 None] snapshot_file for this snap is: volume-483db631-eaa0-404f-b4c8-e5b611ed3376.bd63253f-a5e7-4688-b951-26cab49b4990 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:57:53 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a336499-4ceb-44f0-9a6b-c561bd27c2cb]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:57:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b55404ca-f6be-4277-8856-53e6e85e4a92 tempest-SnapshotMetadataTestJSON-2009965371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.bd63253f-a5e7-4688-b951-26cab49b4990 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:53 devstack sudo[84776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.bd63253f-a5e7-4688-b951-26cab49b4990 Apr 16 22:57:53 devstack sudo[84776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:54 devstack sudo[84776]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b55404ca-f6be-4277-8856-53e6e85e4a92 tempest-SnapshotMetadataTestJSON-2009965371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.bd63253f-a5e7-4688-b951-26cab49b4990" returned: 0 in 0.671s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:54 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-b55404ca-f6be-4277-8856-53e6e85e4a92 tempest-SnapshotMetadataTestJSON-2009965371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-483db631-eaa0-404f-b4c8-e5b611ed3376(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:57:54 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[33dbc407-bf13-48df-99eb-937b43852a8c]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:57:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b55404ca-f6be-4277-8856-53e6e85e4a92 tempest-SnapshotMetadataTestJSON-2009965371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:54 devstack sudo[84781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376 Apr 16 22:57:54 devstack sudo[84781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:54 devstack sudo[84781]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b55404ca-f6be-4277-8856-53e6e85e4a92 tempest-SnapshotMetadataTestJSON-2009965371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376" returned: 0 in 0.587s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b55404ca-f6be-4277-8856-53e6e85e4a92 tempest-SnapshotMetadataTestJSON-2009965371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.bd63253f-a5e7-4688-b951-26cab49b4990 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:54 devstack sudo[84786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.bd63253f-a5e7-4688-b951-26cab49b4990 Apr 16 22:57:54 devstack sudo[84786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:55 devstack sudo[84786]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b55404ca-f6be-4277-8856-53e6e85e4a92 tempest-SnapshotMetadataTestJSON-2009965371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.bd63253f-a5e7-4688-b951-26cab49b4990" returned: 0 in 0.607s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b55404ca-f6be-4277-8856-53e6e85e4a92 tempest-SnapshotMetadataTestJSON-2009965371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.bd63253f-a5e7-4688-b951-26cab49b4990 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:55 devstack sudo[84791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.bd63253f-a5e7-4688-b951-26cab49b4990 Apr 16 22:57:55 devstack sudo[84791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:55 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-5c5dedc3-5fbe-495e-8a72-e68093c983e3 tempest-GroupSnapshotsTest-545220734 None] Group tempest-GroupSnapshotsTest-Group-1311925302: creating Apr 16 22:57:55 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-5c5dedc3-5fbe-495e-8a72-e68093c983e3 tempest-GroupSnapshotsTest-545220734 None] Group tempest-GroupSnapshotsTest-Group-1311925302: created successfully Apr 16 22:57:55 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-5c5dedc3-5fbe-495e-8a72-e68093c983e3 tempest-GroupSnapshotsTest-545220734 None] Create group completed successfully. Apr 16 22:57:55 devstack sudo[84791]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b55404ca-f6be-4277-8856-53e6e85e4a92 tempest-SnapshotMetadataTestJSON-2009965371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376.bd63253f-a5e7-4688-b951-26cab49b4990" returned: 0 in 0.488s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:55 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b55404ca-f6be-4277-8856-53e6e85e4a92 tempest-SnapshotMetadataTestJSON-2009965371 None] Lock "cinder-quobyte-bd63253f-a5e7-4688-b951-26cab49b4990" released by "_delete_snapshot" :: held 2.444s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:57:55 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b55404ca-f6be-4277-8856-53e6e85e4a92 tempest-SnapshotMetadataTestJSON-2009965371 None] Lock "cinder-quobyte-483db631-eaa0-404f-b4c8-e5b611ed3376" released by "delete_snapshot" :: held 2.468s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:57:55 devstack cinder-volume[81971]: WARNING cinder.quota [None req-b55404ca-f6be-4277-8856-53e6e85e4a92 tempest-SnapshotMetadataTestJSON-2009965371 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:57:55 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-b55404ca-f6be-4277-8856-53e6e85e4a92 tempest-SnapshotMetadataTestJSON-2009965371 None] Created reservations ['50d9b341-c520-480f-aa6c-b9cb4faaaac7', '02727f44-3939-4d77-8a6e-c7fefd597a8c', '790a5afd-ac78-4a3c-882f-ad074bee25a0', 'e64459cd-f27b-4b2b-8f37-96ff18f8bfea'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:57:56 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-b55404ca-f6be-4277-8856-53e6e85e4a92 tempest-SnapshotMetadataTestJSON-2009965371 None] Delete snapshot completed successfully. Apr 16 22:57:56 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b55404ca-f6be-4277-8856-53e6e85e4a92 tempest-SnapshotMetadataTestJSON-2009965371 None] Lock "cinder-bd63253f-a5e7-4688-b951-26cab49b4990-delete_snapshot" released by "delete_snapshot" :: held 2.587s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:57:56 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d6e50c83-24a5-4642-b998-b01c48d3a9df tempest-SnapshotMetadataTestJSON-2009965371 None] Acquiring lock "cinder-483db631-eaa0-404f-b4c8-e5b611ed3376-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:57:56 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d6e50c83-24a5-4642-b998-b01c48d3a9df tempest-SnapshotMetadataTestJSON-2009965371 None] Lock "cinder-483db631-eaa0-404f-b4c8-e5b611ed3376-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:57:56 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d6e50c83-24a5-4642-b998-b01c48d3a9df tempest-SnapshotMetadataTestJSON-2009965371 None] Acquiring lock "cinder-quobyte-483db631-eaa0-404f-b4c8-e5b611ed3376" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:57:56 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d6e50c83-24a5-4642-b998-b01c48d3a9df tempest-SnapshotMetadataTestJSON-2009965371 None] Lock "cinder-quobyte-483db631-eaa0-404f-b4c8-e5b611ed3376" acquired by "delete_volume" :: waited 0.018s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:57:56 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a37d47f-6717-48eb-a730-166c4f101a6a]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:57:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d6e50c83-24a5-4642-b998-b01c48d3a9df tempest-SnapshotMetadataTestJSON-2009965371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:56 devstack sudo[84795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376 Apr 16 22:57:56 devstack sudo[84795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Flow 'volume_create_manager' (ed112a7a-df6a-42f8-898e-4797f1eaa171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac52cb5a-aa7f-4414-aaa6-ec173083b4d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac52cb5a-aa7f-4414-aaa6-ec173083b4d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1404405493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b8c0feb-a9b8-4267-aae5-577cd09d292e,host='devstack@QuobyteHD#QuobyteHD',id=e7bed109-39bd-40ae-8694-a36011b26ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d1e231403084f8bafa7279cc624180f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:57:57Z,use_quota=True,user_id='046548c5a7df409691cc08d2a6ba412b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cceb8666-ec5c-4af0-a123-2e1ab4768af2),volume_type_id=cceb8666-ec5c-4af0-a123-2e1ab4768af2)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57fad63a-bdfc-475c-8dce-3d9edf1a3660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57fad63a-bdfc-475c-8dce-3d9edf1a3660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d584f050-3b86-48c1-8d28-c105217c4529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d584f050-3b86-48c1-8d28-c105217c4529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7bed109-39bd-40ae-8694-a36011b26ff7', 'volume_name': 'volume-e7bed109-39bd-40ae-8694-a36011b26ff7', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b85285-b346-4d9f-ae00-209d592ed532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80b85285-b346-4d9f-ae00-209d592ed532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f646b9c1-6559-4a0f-90e5-cb5b4c06b9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:57 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Volume e7bed109-39bd-40ae-8694-a36011b26ff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7bed109-39bd-40ae-8694-a36011b26ff7', 'volume_size': 1} Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7b8c0feb-a9b8-4267-aae5-577cd09d292e,created_at=2026-04-16T20:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1404405493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7b8c0feb-a9b8-4267-aae5-577cd09d292e,host='devstack@QuobyteHD#QuobyteHD',id=e7bed109-39bd-40ae-8694-a36011b26ff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d1e231403084f8bafa7279cc624180f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:57:57Z,use_quota=True,user_id='046548c5a7df409691cc08d2a6ba412b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cceb8666-ec5c-4af0-a123-2e1ab4768af2),volume_type_id=cceb8666-ec5c-4af0-a123-2e1ab4768af2)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Creating volume e7bed109-39bd-40ae-8694-a36011b26ff7 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:57:57 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:57 devstack sudo[84799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7 1073741824 Apr 16 22:57:57 devstack sudo[84799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:57 devstack sudo[84795]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d6e50c83-24a5-4642-b998-b01c48d3a9df tempest-SnapshotMetadataTestJSON-2009965371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376" returned: 0 in 0.649s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d6e50c83-24a5-4642-b998-b01c48d3a9df tempest-SnapshotMetadataTestJSON-2009965371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:57 devstack sudo[84847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376 Apr 16 22:57:57 devstack sudo[84847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:57 devstack sudo[84799]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7 1073741824" returned: 0 in 0.663s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:57 devstack sudo[84884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7 Apr 16 22:57:57 devstack sudo[84884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:58 devstack sudo[84847]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d6e50c83-24a5-4642-b998-b01c48d3a9df tempest-SnapshotMetadataTestJSON-2009965371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-483db631-eaa0-404f-b4c8-e5b611ed3376" returned: 0 in 0.841s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:58 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d6e50c83-24a5-4642-b998-b01c48d3a9df tempest-SnapshotMetadataTestJSON-2009965371 None] Lock "cinder-quobyte-483db631-eaa0-404f-b4c8-e5b611ed3376" released by "delete_volume" :: held 1.533s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:57:58 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-d6e50c83-24a5-4642-b998-b01c48d3a9df tempest-SnapshotMetadataTestJSON-2009965371 None] Created reservations ['532b7c55-3cc8-4848-9fef-cd217292455c', '32cd63e5-1919-4cf4-a4c6-0a1bea606b6c', '50b221b1-a0a8-4a81-9ce0-707d591d1a05', '0fda38cd-6371-49cd-9002-760aee2af659'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:57:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d6e50c83-24a5-4642-b998-b01c48d3a9df tempest-SnapshotMetadataTestJSON-2009965371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d6e50c83-24a5-4642-b998-b01c48d3a9df tempest-SnapshotMetadataTestJSON-2009965371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:58 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d6e50c83-24a5-4642-b998-b01c48d3a9df tempest-SnapshotMetadataTestJSON-2009965371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:57:58 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d6e50c83-24a5-4642-b998-b01c48d3a9df tempest-SnapshotMetadataTestJSON-2009965371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:57:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d6e50c83-24a5-4642-b998-b01c48d3a9df tempest-SnapshotMetadataTestJSON-2009965371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d6e50c83-24a5-4642-b998-b01c48d3a9df tempest-SnapshotMetadataTestJSON-2009965371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:58 devstack sudo[84888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:57:58 devstack sudo[84888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:57:58 devstack sudo[84884]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7" returned: 0 in 0.818s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:58 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:57:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:57:58 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f646b9c1-6559-4a0f-90e5-cb5b4c06b9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7bed109-39bd-40ae-8694-a36011b26ff7', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:58 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19528e2a-55a5-4171-b354-6cb343625039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:57:58 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Volume volume-e7bed109-39bd-40ae-8694-a36011b26ff7 (e7bed109-39bd-40ae-8694-a36011b26ff7): created successfully Apr 16 22:57:58 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19528e2a-55a5-4171-b354-6cb343625039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:57:58 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Flow 'volume_create_manager' (ed112a7a-df6a-42f8-898e-4797f1eaa171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:57:58 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-cdcb19df-e875-4e6f-8968-0647b65f9249 tempest-GroupSnapshotsTest-545220734 None] Created volume successfully. Apr 16 22:57:58 devstack sudo[84888]: pam_unix(sudo:session): session closed for user root Apr 16 22:57:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d6e50c83-24a5-4642-b998-b01c48d3a9df tempest-SnapshotMetadataTestJSON-2009965371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.474s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:57:58 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-d6e50c83-24a5-4642-b998-b01c48d3a9df tempest-SnapshotMetadataTestJSON-2009965371 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:57:58 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-d6e50c83-24a5-4642-b998-b01c48d3a9df tempest-SnapshotMetadataTestJSON-2009965371 None] Deleted volume successfully. Apr 16 22:57:58 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d6e50c83-24a5-4642-b998-b01c48d3a9df tempest-SnapshotMetadataTestJSON-2009965371 None] Lock "cinder-483db631-eaa0-404f-b4c8-e5b611ed3376-delete_volume" released by "delete_volume" :: held 2.203s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:57:59 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-a96eb0ca-9197-46b2-99bc-1a74650d1321 tempest-GroupSnapshotsTest-545220734 None] GroupSnapshot 1d41aa6b-d6b7-4665-b2dc-169d638af19a: creating. Apr 16 22:57:59 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a96eb0ca-9197-46b2-99bc-1a74650d1321 tempest-GroupSnapshotsTest-545220734 None] Group snapshot 1d41aa6b-d6b7-4665-b2dc-169d638af19a: creating. {{(pid=81971) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 16 22:57:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a96eb0ca-9197-46b2-99bc-1a74650d1321 tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:57:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a96eb0ca-9197-46b2-99bc-1a74650d1321 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:57:59 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-a96eb0ca-9197-46b2-99bc-1a74650d1321 tempest-GroupSnapshotsTest-545220734 None] Creating offline snapshot d4092c04-79cd-4dab-8f2d-802e7a1d3dfc of volume e7bed109-39bd-40ae-8694-a36011b26ff7 {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:57:59 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d325c9-991c-4a96-a7d8-8536b46671d1]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:57:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a96eb0ca-9197-46b2-99bc-1a74650d1321 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:57:59 devstack sudo[84894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7 Apr 16 22:57:59 devstack sudo[84894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:00 devstack sudo[84894]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a96eb0ca-9197-46b2-99bc-1a74650d1321 tempest-GroupSnapshotsTest-545220734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7" returned: 0 in 0.673s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a96eb0ca-9197-46b2-99bc-1a74650d1321 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.d4092c04-79cd-4dab-8f2d-802e7a1d3dfc 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:00 devstack sudo[84924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.d4092c04-79cd-4dab-8f2d-802e7a1d3dfc 1G Apr 16 22:58:00 devstack sudo[84924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:01 devstack sudo[84924]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a96eb0ca-9197-46b2-99bc-1a74650d1321 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.d4092c04-79cd-4dab-8f2d-802e7a1d3dfc 1G" returned: 0 in 0.689s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a96eb0ca-9197-46b2-99bc-1a74650d1321 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7bed109-39bd-40ae-8694-a36011b26ff7 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.d4092c04-79cd-4dab-8f2d-802e7a1d3dfc {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:01 devstack sudo[84932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7bed109-39bd-40ae-8694-a36011b26ff7 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.d4092c04-79cd-4dab-8f2d-802e7a1d3dfc Apr 16 22:58:01 devstack sudo[84932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:01 devstack sudo[84932]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a96eb0ca-9197-46b2-99bc-1a74650d1321 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7bed109-39bd-40ae-8694-a36011b26ff7 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.d4092c04-79cd-4dab-8f2d-802e7a1d3dfc" returned: 0 in 0.720s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:01 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-a96eb0ca-9197-46b2-99bc-1a74650d1321 tempest-GroupSnapshotsTest-545220734 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.d4092c04-79cd-4dab-8f2d-802e7a1d3dfc is being set with open permissions: ugo+rw: NotImplementedError Apr 16 22:58:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a96eb0ca-9197-46b2-99bc-1a74650d1321 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.d4092c04-79cd-4dab-8f2d-802e7a1d3dfc {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:01 devstack sudo[84937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.d4092c04-79cd-4dab-8f2d-802e7a1d3dfc Apr 16 22:58:01 devstack sudo[84937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:02 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:SELECT=82,cinder:INSERT=20,cinder:UPDATE=118,cinder:DELETE=7 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:58:02 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:58:02 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Flow 'volume_create_manager' (22e1bc55-d09a-47f5-8542-9ade734065f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:58:02 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84448c61-14a5-4246-a989-caea998eb6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:02 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84448c61-14a5-4246-a989-caea998eb6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1299067358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6330c8-c2ce-4286-813e-e1cd22854024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2861ad612054e708567ba2b20482d13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:58:02Z,use_quota=True,user_id='73095c6aba1f4ca9bb106021a9ecca40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:02 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3763181-762f-4b03-8dd2-1fd8e101475e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:02 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3763181-762f-4b03-8dd2-1fd8e101475e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:02 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (498aa310-2ad6-4d27-b021-ca66e74f1733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:02 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (498aa310-2ad6-4d27-b021-ca66e74f1733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f6330c8-c2ce-4286-813e-e1cd22854024', 'volume_name': 'volume-2f6330c8-c2ce-4286-813e-e1cd22854024', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:02 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f9afbf-ef73-4c7f-9df0-cbb00e26d750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:02 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f9afbf-ef73-4c7f-9df0-cbb00e26d750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:02 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e6398d-85f1-4703-ae0c-0b39ba5b2788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:02 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Volume 2f6330c8-c2ce-4286-813e-e1cd22854024: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f6330c8-c2ce-4286-813e-e1cd22854024', 'volume_size': 1} Apr 16 22:58:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:02 devstack sudo[84937]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a96eb0ca-9197-46b2-99bc-1a74650d1321 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.d4092c04-79cd-4dab-8f2d-802e7a1d3dfc" returned: 0 in 0.636s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a96eb0ca-9197-46b2-99bc-1a74650d1321 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:02 devstack sudo[84969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.info Apr 16 22:58:02 devstack sudo[84969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:03 devstack sudo[84969]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a96eb0ca-9197-46b2-99bc-1a74650d1321 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.info" returned: 0 in 0.691s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:03 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-a96eb0ca-9197-46b2-99bc-1a74650d1321 tempest-GroupSnapshotsTest-545220734 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 22:58:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a96eb0ca-9197-46b2-99bc-1a74650d1321 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:03 devstack sudo[84995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.info Apr 16 22:58:03 devstack sudo[84995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:03 devstack sudo[84995]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a96eb0ca-9197-46b2-99bc-1a74650d1321 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.info" returned: 0 in 0.637s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a96eb0ca-9197-46b2-99bc-1a74650d1321 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.166s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.756s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1299067358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f6330c8-c2ce-4286-813e-e1cd22854024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2861ad612054e708567ba2b20482d13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:58:02Z,use_quota=True,user_id='73095c6aba1f4ca9bb106021a9ecca40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:58:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Creating volume 2f6330c8-c2ce-4286-813e-e1cd22854024 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:58:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:58:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:58:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:58:03 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:58:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f6330c8-c2ce-4286-813e-e1cd22854024 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:03 devstack sudo[85020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f6330c8-c2ce-4286-813e-e1cd22854024 1073741824 Apr 16 22:58:03 devstack sudo[85020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:04 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-a96eb0ca-9197-46b2-99bc-1a74650d1321 tempest-GroupSnapshotsTest-545220734 None] group_snapshot 1d41aa6b-d6b7-4665-b2dc-169d638af19a: created successfully Apr 16 22:58:04 devstack sudo[85020]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f6330c8-c2ce-4286-813e-e1cd22854024 1073741824" returned: 0 in 0.752s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f6330c8-c2ce-4286-813e-e1cd22854024 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:04 devstack sudo[85028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f6330c8-c2ce-4286-813e-e1cd22854024 Apr 16 22:58:04 devstack sudo[85028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:04 devstack cinder-volume[81971]: DEBUG oslo_service.periodic_task [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81971) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:58:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:58:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:58:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:04 devstack sudo[85030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:58:04 devstack sudo[85030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:05 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-fe60a7bc-9540-415d-98f1-4923209850ed tempest-VolumesActionsTest-148448383 None] Acquiring lock "cinder-57104bb9-81ac-49ad-802f-92c92256ccc0" by "attach_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:58:05 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-fe60a7bc-9540-415d-98f1-4923209850ed tempest-VolumesActionsTest-148448383 None] Lock "cinder-57104bb9-81ac-49ad-802f-92c92256ccc0" acquired by "attach_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:58:05 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-fe60a7bc-9540-415d-98f1-4923209850ed tempest-VolumesActionsTest-148448383 None] Attaching volume 57104bb9-81ac-49ad-802f-92c92256ccc0 to instance 2e09b2b6-22c5-4193-b524-b988fda8676c at mountpoint /dev/vdb on host None. Apr 16 22:58:05 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-fe60a7bc-9540-415d-98f1-4923209850ed tempest-VolumesActionsTest-148448383 None] Attach volume completed successfully. Apr 16 22:58:05 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-fe60a7bc-9540-415d-98f1-4923209850ed tempest-VolumesActionsTest-148448383 None] Lock "cinder-57104bb9-81ac-49ad-802f-92c92256ccc0" released by "attach_volume" :: held 0.064s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:58:05 devstack sudo[85028]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f6330c8-c2ce-4286-813e-e1cd22854024" returned: 0 in 0.597s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:05 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:58:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e6398d-85f1-4703-ae0c-0b39ba5b2788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f6330c8-c2ce-4286-813e-e1cd22854024', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ad7727-1a52-4fcf-9f5b-fdfdf30552f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:05 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Volume volume-2f6330c8-c2ce-4286-813e-e1cd22854024 (2f6330c8-c2ce-4286-813e-e1cd22854024): created successfully Apr 16 22:58:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ad7727-1a52-4fcf-9f5b-fdfdf30552f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Flow 'volume_create_manager' (22e1bc55-d09a-47f5-8542-9ade734065f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:58:05 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-607c2b68-9d14-4a72-818f-42337e5d9c50 tempest-AbsoluteLimitsTests-8547504 None] Created volume successfully. Apr 16 22:58:05 devstack sudo[85030]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.598s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:05 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f6943384-155d-49cf-aa0d-bb49e11d43b2 tempest-VolumesActionsTest-148448383 None] Acquiring lock "cinder-57104bb9-81ac-49ad-802f-92c92256ccc0-detach_volume" by "detach_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-30c9e287-728e-4359-8375-991086ccdb67 tempest-AbsoluteLimitsTests-8547504 None] Acquiring lock "cinder-2f6330c8-c2ce-4286-813e-e1cd22854024-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-30c9e287-728e-4359-8375-991086ccdb67 tempest-AbsoluteLimitsTests-8547504 None] Lock "cinder-2f6330c8-c2ce-4286-813e-e1cd22854024-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f6943384-155d-49cf-aa0d-bb49e11d43b2 tempest-VolumesActionsTest-148448383 None] Lock "cinder-57104bb9-81ac-49ad-802f-92c92256ccc0-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:58:06 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-f6943384-155d-49cf-aa0d-bb49e11d43b2 tempest-VolumesActionsTest-148448383 None] Detaching volume 57104bb9-81ac-49ad-802f-92c92256ccc0 from instance 2e09b2b6-22c5-4193-b524-b988fda8676c. Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-30c9e287-728e-4359-8375-991086ccdb67 tempest-AbsoluteLimitsTests-8547504 None] Acquiring lock "cinder-quobyte-2f6330c8-c2ce-4286-813e-e1cd22854024" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "cinder-quobyte-d4092c04-79cd-4dab-8f2d-802e7a1d3dfc-e7a2a1d4-8581-49fb-9112-c31472daa04b" by "_create_volume_from_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-30c9e287-728e-4359-8375-991086ccdb67 tempest-AbsoluteLimitsTests-8547504 None] Lock "cinder-quobyte-2f6330c8-c2ce-4286-813e-e1cd22854024" acquired by "delete_volume" :: waited 0.033s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-d4092c04-79cd-4dab-8f2d-802e7a1d3dfc-e7a2a1d4-8581-49fb-9112-c31472daa04b" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Creating volume e7a2a1d4-8581-49fb-9112-c31472daa04b from snapshot d4092c04-79cd-4dab-8f2d-802e7a1d3dfc {{(pid=81971) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "cinder-quobyte-e7a2a1d4-8581-49fb-9112-c31472daa04b" by "_copy_volume_from_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28d39ab-69b9-40ee-86f7-d8df7d440661]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:06 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-f6943384-155d-49cf-aa0d-bb49e11d43b2 tempest-VolumesActionsTest-148448383 None] Detach volume completed successfully. Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-30c9e287-728e-4359-8375-991086ccdb67 tempest-AbsoluteLimitsTests-8547504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f6330c8-c2ce-4286-813e-e1cd22854024 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f6943384-155d-49cf-aa0d-bb49e11d43b2 tempest-VolumesActionsTest-148448383 None] Lock "cinder-57104bb9-81ac-49ad-802f-92c92256ccc0-detach_volume" released by "detach_volume" :: held 0.155s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-e7a2a1d4-8581-49fb-9112-c31472daa04b" acquired by "_copy_volume_from_snapshot" :: waited 0.047s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] snapshot: d4092c04-79cd-4dab-8f2d-802e7a1d3dfc, volume: e7a2a1d4-8581-49fb-9112-c31472daa04b, {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9509cc7-9549-4c7c-93f2-00e81fabe7cf]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.d4092c04-79cd-4dab-8f2d-802e7a1d3dfc {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:06 devstack sudo[85035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f6330c8-c2ce-4286-813e-e1cd22854024 Apr 16 22:58:06 devstack sudo[85035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:06 devstack sudo[85036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.d4092c04-79cd-4dab-8f2d-802e7a1d3dfc Apr 16 22:58:06 devstack sudo[85036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:06 devstack sudo[85035]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-30c9e287-728e-4359-8375-991086ccdb67 tempest-AbsoluteLimitsTests-8547504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f6330c8-c2ce-4286-813e-e1cd22854024" returned: 0 in 0.721s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-30c9e287-728e-4359-8375-991086ccdb67 tempest-AbsoluteLimitsTests-8547504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f6330c8-c2ce-4286-813e-e1cd22854024 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:06 devstack sudo[85047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f6330c8-c2ce-4286-813e-e1cd22854024 Apr 16 22:58:06 devstack sudo[85047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:07 devstack sudo[85036]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.d4092c04-79cd-4dab-8f2d-802e7a1d3dfc" returned: 0 in 0.807s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7bed109-39bd-40ae-8694-a36011b26ff7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:58:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7 {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 22:58:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Creating direct copy from snapshot {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 22:58:07 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af5b819-3a4a-4d35-bcbf-4b7254c13e14]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:07 devstack sudo[85054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7 Apr 16 22:58:07 devstack sudo[85054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:07 devstack sudo[85047]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-30c9e287-728e-4359-8375-991086ccdb67 tempest-AbsoluteLimitsTests-8547504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f6330c8-c2ce-4286-813e-e1cd22854024" returned: 0 in 0.559s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:07 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-30c9e287-728e-4359-8375-991086ccdb67 tempest-AbsoluteLimitsTests-8547504 None] Lock "cinder-quobyte-2f6330c8-c2ce-4286-813e-e1cd22854024" released by "delete_volume" :: held 1.332s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:58:07 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-30c9e287-728e-4359-8375-991086ccdb67 tempest-AbsoluteLimitsTests-8547504 None] Created reservations ['0ea486a2-7e04-48d8-bd31-0ee6023b2917', 'ed56b048-434f-4e94-8599-561f6f8a3982', '3fdf0a5e-821a-4203-b9d9-e70d1203789a', '98ddcd07-bab7-48ed-8305-bc7d559e16bb'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:58:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-30c9e287-728e-4359-8375-991086ccdb67 tempest-AbsoluteLimitsTests-8547504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-30c9e287-728e-4359-8375-991086ccdb67 tempest-AbsoluteLimitsTests-8547504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-30c9e287-728e-4359-8375-991086ccdb67 tempest-AbsoluteLimitsTests-8547504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:58:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-30c9e287-728e-4359-8375-991086ccdb67 tempest-AbsoluteLimitsTests-8547504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:58:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-30c9e287-728e-4359-8375-991086ccdb67 tempest-AbsoluteLimitsTests-8547504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-30c9e287-728e-4359-8375-991086ccdb67 tempest-AbsoluteLimitsTests-8547504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:07 devstack sudo[85059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:58:07 devstack sudo[85059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:07 devstack sudo[85054]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7" returned: 0 in 0.639s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:07 devstack cinder-volume[81971]: DEBUG cinder.utils [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Path /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7a2a1d4-8581-49fb-9112-c31472daa04b not found in is_blk_device check {{(pid=81971) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 22:58:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7a2a1d4-8581-49fb-9112-c31472daa04b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:07 devstack sudo[85068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7a2a1d4-8581-49fb-9112-c31472daa04b Apr 16 22:58:07 devstack sudo[85068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:08 devstack sudo[85059]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-30c9e287-728e-4359-8375-991086ccdb67 tempest-AbsoluteLimitsTests-8547504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.507s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:08 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-30c9e287-728e-4359-8375-991086ccdb67 tempest-AbsoluteLimitsTests-8547504 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:58:08 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-30c9e287-728e-4359-8375-991086ccdb67 tempest-AbsoluteLimitsTests-8547504 None] Deleted volume successfully. Apr 16 22:58:08 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-30c9e287-728e-4359-8375-991086ccdb67 tempest-AbsoluteLimitsTests-8547504 None] Lock "cinder-2f6330c8-c2ce-4286-813e-e1cd22854024-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:58:11 devstack sudo[85068]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7a2a1d4-8581-49fb-9112-c31472daa04b" returned: 0 in 3.384s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:11 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0e2f7e-f29b-419b-a5e7-de9038f3137f]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:11 devstack sudo[85121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7 Apr 16 22:58:11 devstack sudo[85121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:11 devstack sudo[85121]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7" returned: 0 in 0.781s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:11 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Image conversion details: src /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7, size 1024.00 MB, duration 3.38 sec, destination /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7a2a1d4-8581-49fb-9112-c31472daa04b {{(pid=81971) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:58:11 devstack cinder-volume[81971]: INFO cinder.image.image_utils [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Converted 1024.00 MB image at 302.53 MB/s Apr 16 22:58:11 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7a2a1d4-8581-49fb-9112-c31472daa04b is being set with open permissions: ugo+rw: NotImplementedError Apr 16 22:58:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7a2a1d4-8581-49fb-9112-c31472daa04b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:12 devstack sudo[85127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7a2a1d4-8581-49fb-9112-c31472daa04b Apr 16 22:58:12 devstack sudo[85127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:12 devstack sudo[85127]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7a2a1d4-8581-49fb-9112-c31472daa04b" returned: 0 in 0.696s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:12 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-e7a2a1d4-8581-49fb-9112-c31472daa04b" released by "_copy_volume_from_snapshot" :: held 6.422s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:58:12 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-d4092c04-79cd-4dab-8f2d-802e7a1d3dfc-e7a2a1d4-8581-49fb-9112-c31472daa04b" released by "_create_volume_from_snapshot" :: held 6.479s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:58:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.513s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:12 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:SELECT=102,cinder:UPDATE=106,cinder:DELETE=13,cinder:INSERT=35 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:58:12 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-c09d13c9-aa79-4684-a644-61fa4b9f12e0 tempest-GroupSnapshotsTest-545220734 None] Create group from source-snapshot-1d41aa6b-d6b7-4665-b2dc-169d638af19a completed successfully. Apr 16 22:58:13 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a6b817fc-dbef-4715-8c13-1ab7ccec7549 tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "cinder-quobyte-e7a2a1d4-8581-49fb-9112-c31472daa04b" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:58:13 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a6b817fc-dbef-4715-8c13-1ab7ccec7549 tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-e7a2a1d4-8581-49fb-9112-c31472daa04b" acquired by "delete_volume" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:58:13 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[455ba225-7ca6-492c-9830-cda2eb87cc3a]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a6b817fc-dbef-4715-8c13-1ab7ccec7549 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7a2a1d4-8581-49fb-9112-c31472daa04b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:13 devstack sudo[85145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7a2a1d4-8581-49fb-9112-c31472daa04b Apr 16 22:58:13 devstack sudo[85145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:14 devstack sudo[85145]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a6b817fc-dbef-4715-8c13-1ab7ccec7549 tempest-GroupSnapshotsTest-545220734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7a2a1d4-8581-49fb-9112-c31472daa04b" returned: 0 in 0.610s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a6b817fc-dbef-4715-8c13-1ab7ccec7549 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7a2a1d4-8581-49fb-9112-c31472daa04b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:14 devstack sudo[85152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7a2a1d4-8581-49fb-9112-c31472daa04b Apr 16 22:58:14 devstack sudo[85152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Flow 'volume_create_manager' (b152b8d4-f212-45e7-b079-62b1aa531ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6319b726-e3b7-4ffa-aae4-386845a754c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6319b726-e3b7-4ffa-aae4-386845a754c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1350373137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c539b55b-0d8c-4f65-a0c5-810547f4ba79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3c8026888a4331bb6d6bbee020c628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:58:14Z,use_quota=True,user_id='9ecbabdc875140afb041fcb7bffbffa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f3b7bb-edba-4a53-afc6-d35f9e16a067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f3b7bb-edba-4a53-afc6-d35f9e16a067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ccfbe77-0131-47de-8b84-397841b121e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ccfbe77-0131-47de-8b84-397841b121e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c539b55b-0d8c-4f65-a0c5-810547f4ba79', 'volume_name': 'volume-c539b55b-0d8c-4f65-a0c5-810547f4ba79', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5087cf91-f25c-4756-8744-7b4eded4a16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5087cf91-f25c-4756-8744-7b4eded4a16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1d937dc-e4d2-4f95-ad71-1c9c5413a1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:14 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Volume c539b55b-0d8c-4f65-a0c5-810547f4ba79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c539b55b-0d8c-4f65-a0c5-810547f4ba79', 'volume_size': 1} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1350373137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c539b55b-0d8c-4f65-a0c5-810547f4ba79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3c8026888a4331bb6d6bbee020c628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:58:14Z,use_quota=True,user_id='9ecbabdc875140afb041fcb7bffbffa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Creating volume c539b55b-0d8c-4f65-a0c5-810547f4ba79 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:58:14 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c539b55b-0d8c-4f65-a0c5-810547f4ba79 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:14 devstack sudo[85154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c539b55b-0d8c-4f65-a0c5-810547f4ba79 1073741824 Apr 16 22:58:14 devstack sudo[85154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:14 devstack sudo[85152]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a6b817fc-dbef-4715-8c13-1ab7ccec7549 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7a2a1d4-8581-49fb-9112-c31472daa04b" returned: 0 in 0.537s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a6b817fc-dbef-4715-8c13-1ab7ccec7549 tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-e7a2a1d4-8581-49fb-9112-c31472daa04b" released by "delete_volume" :: held 1.183s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-a6b817fc-dbef-4715-8c13-1ab7ccec7549 tempest-GroupSnapshotsTest-545220734 None] Created reservations ['84a87593-125d-4065-8569-aadb12c39192'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:58:14 devstack cinder-volume[81971]: WARNING cinder.quota [None req-a6b817fc-dbef-4715-8c13-1ab7ccec7549 tempest-GroupSnapshotsTest-545220734 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1885825555 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1885825555, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:58:14 devstack cinder-volume[81971]: WARNING cinder.quota [None req-a6b817fc-dbef-4715-8c13-1ab7ccec7549 tempest-GroupSnapshotsTest-545220734 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1885825555 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1885825555, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-a6b817fc-dbef-4715-8c13-1ab7ccec7549 tempest-GroupSnapshotsTest-545220734 None] Created reservations ['b59c1545-d0ae-4109-82e2-a4748e8cc881', '1a215310-43ab-4e95-9f89-c4b90c8e5799', 'ea2ba97b-143c-4d6b-9b7d-3b1f779ba9b9', '70d1b4af-8a6c-4b85-ba65-7abb2a2d6a2e'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a6b817fc-dbef-4715-8c13-1ab7ccec7549 tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a6b817fc-dbef-4715-8c13-1ab7ccec7549 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a6b817fc-dbef-4715-8c13-1ab7ccec7549 tempest-GroupSnapshotsTest-545220734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a6b817fc-dbef-4715-8c13-1ab7ccec7549 tempest-GroupSnapshotsTest-545220734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a6b817fc-dbef-4715-8c13-1ab7ccec7549 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a6b817fc-dbef-4715-8c13-1ab7ccec7549 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:15 devstack sudo[85159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:58:15 devstack sudo[85159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:15 devstack sudo[85154]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c539b55b-0d8c-4f65-a0c5-810547f4ba79 1073741824" returned: 0 in 0.650s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c539b55b-0d8c-4f65-a0c5-810547f4ba79 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:15 devstack sudo[85162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c539b55b-0d8c-4f65-a0c5-810547f4ba79 Apr 16 22:58:15 devstack sudo[85162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:15 devstack sudo[85159]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a6b817fc-dbef-4715-8c13-1ab7ccec7549 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.485s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:15 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-a6b817fc-dbef-4715-8c13-1ab7ccec7549 tempest-GroupSnapshotsTest-545220734 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:58:15 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-a6b817fc-dbef-4715-8c13-1ab7ccec7549 tempest-GroupSnapshotsTest-545220734 None] Delete group completed successfully. Apr 16 22:58:15 devstack sudo[85162]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c539b55b-0d8c-4f65-a0c5-810547f4ba79" returned: 0 in 0.469s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:58:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1d937dc-e4d2-4f95-ad71-1c9c5413a1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c539b55b-0d8c-4f65-a0c5-810547f4ba79', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10c3312c-491b-4f20-9089-6eee1c81abf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:15 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Volume volume-c539b55b-0d8c-4f65-a0c5-810547f4ba79 (c539b55b-0d8c-4f65-a0c5-810547f4ba79): created successfully Apr 16 22:58:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10c3312c-491b-4f20-9089-6eee1c81abf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Flow 'volume_create_manager' (b152b8d4-f212-45e7-b079-62b1aa531ace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:58:15 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-9095629d-7f8e-4592-ba9b-413d4b313524 tempest-VolumesTransfersV357Test-134390671 None] Created volume successfully. Apr 16 22:58:15 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-be71dfc9-d4fc-435d-89ce-7d0c44ec3020 tempest-GroupSnapshotsTest-545220734 None] group_snapshot 1d41aa6b-d6b7-4665-b2dc-169d638af19a: deleting Apr 16 22:58:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-be71dfc9-d4fc-435d-89ce-7d0c44ec3020 tempest-GroupSnapshotsTest-545220734 None] group_snapshot 1d41aa6b-d6b7-4665-b2dc-169d638af19a: deleting {{(pid=81971) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 16 22:58:15 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-be71dfc9-d4fc-435d-89ce-7d0c44ec3020 tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "cinder-quobyte-e7bed109-39bd-40ae-8694-a36011b26ff7" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:58:15 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-be71dfc9-d4fc-435d-89ce-7d0c44ec3020 tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-e7bed109-39bd-40ae-8694-a36011b26ff7" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:58:15 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-be71dfc9-d4fc-435d-89ce-7d0c44ec3020 tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "cinder-quobyte-d4092c04-79cd-4dab-8f2d-802e7a1d3dfc" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:58:15 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-be71dfc9-d4fc-435d-89ce-7d0c44ec3020 tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-d4092c04-79cd-4dab-8f2d-802e7a1d3dfc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:58:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-be71dfc9-d4fc-435d-89ce-7d0c44ec3020 tempest-GroupSnapshotsTest-545220734 None] Deleting offline snapshot d4092c04-79cd-4dab-8f2d-802e7a1d3dfc of volume e7bed109-39bd-40ae-8694-a36011b26ff7 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:58:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-be71dfc9-d4fc-435d-89ce-7d0c44ec3020 tempest-GroupSnapshotsTest-545220734 None] snapshot_file for this snap is: volume-e7bed109-39bd-40ae-8694-a36011b26ff7.d4092c04-79cd-4dab-8f2d-802e7a1d3dfc {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:58:15 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72be05a-7a6c-4276-a880-febaf6011428]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-be71dfc9-d4fc-435d-89ce-7d0c44ec3020 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.d4092c04-79cd-4dab-8f2d-802e7a1d3dfc {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2a40d978-5816-44c0-ae87-90566b314550 tempest-VolumesActionsTest-148448383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2a40d978-5816-44c0-ae87-90566b314550 tempest-VolumesActionsTest-148448383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:15 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[904d5a3f-da3d-4837-8725-80d9c498fc0b]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a40d978-5816-44c0-ae87-90566b314550 tempest-VolumesActionsTest-148448383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:15 devstack sudo[85166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.d4092c04-79cd-4dab-8f2d-802e7a1d3dfc Apr 16 22:58:15 devstack sudo[85166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:15 devstack sudo[85167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 Apr 16 22:58:15 devstack sudo[85167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:16 devstack sudo[85167]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a40d978-5816-44c0-ae87-90566b314550 tempest-VolumesActionsTest-148448383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0" returned: 0 in 0.520s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:16 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb99691-01df-47e2-aef4-59b77dd9e5e5]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a40d978-5816-44c0-ae87-90566b314550 tempest-VolumesActionsTest-148448383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:16 devstack sudo[85166]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-be71dfc9-d4fc-435d-89ce-7d0c44ec3020 tempest-GroupSnapshotsTest-545220734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.d4092c04-79cd-4dab-8f2d-802e7a1d3dfc" returned: 0 in 0.594s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:16 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-be71dfc9-d4fc-435d-89ce-7d0c44ec3020 tempest-GroupSnapshotsTest-545220734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7bed109-39bd-40ae-8694-a36011b26ff7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:58:16 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae6a900-1d4d-437a-aca4-dca5869f5986]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-be71dfc9-d4fc-435d-89ce-7d0c44ec3020 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:16 devstack sudo[85186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 Apr 16 22:58:16 devstack sudo[85186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:16 devstack sudo[85187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7 Apr 16 22:58:16 devstack sudo[85187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:16 devstack sudo[85186]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a40d978-5816-44c0-ae87-90566b314550 tempest-VolumesActionsTest-148448383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0" returned: 0 in 0.524s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a40d978-5816-44c0-ae87-90566b314550 tempest-VolumesActionsTest-148448383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 /opt/stack/data/cinder/conversion/57104bb9-81ac-49ad-802f-92c92256ccc0.temp_image.a7f34672-eab8-4cb7-80fe-2c0dd9f55d750csbd0l2.img {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:17 devstack sudo[85196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 /opt/stack/data/cinder/conversion/57104bb9-81ac-49ad-802f-92c92256ccc0.temp_image.a7f34672-eab8-4cb7-80fe-2c0dd9f55d750csbd0l2.img Apr 16 22:58:17 devstack sudo[85196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:17 devstack sudo[85187]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-be71dfc9-d4fc-435d-89ce-7d0c44ec3020 tempest-GroupSnapshotsTest-545220734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7" returned: 0 in 0.565s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-be71dfc9-d4fc-435d-89ce-7d0c44ec3020 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.d4092c04-79cd-4dab-8f2d-802e7a1d3dfc {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:17 devstack sudo[85198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.d4092c04-79cd-4dab-8f2d-802e7a1d3dfc Apr 16 22:58:17 devstack sudo[85198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:17 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-85f44be2-8028-4996-b32b-968257b6881d tempest-VolumesTransfersV357Test-1806585514 None] Transfer volume completed successfully. Apr 16 22:58:17 devstack sudo[85198]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-be71dfc9-d4fc-435d-89ce-7d0c44ec3020 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.d4092c04-79cd-4dab-8f2d-802e7a1d3dfc" returned: 0 in 0.901s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-be71dfc9-d4fc-435d-89ce-7d0c44ec3020 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.d4092c04-79cd-4dab-8f2d-802e7a1d3dfc {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:18 devstack sudo[85234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.d4092c04-79cd-4dab-8f2d-802e7a1d3dfc Apr 16 22:58:18 devstack sudo[85234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:19 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-06b36a92-ba82-4ede-8d1b-4663d61ffd42 tempest-VolumesTransfersV357Test-59777751 None] Acquiring lock "cinder-c539b55b-0d8c-4f65-a0c5-810547f4ba79-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:58:19 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-06b36a92-ba82-4ede-8d1b-4663d61ffd42 tempest-VolumesTransfersV357Test-59777751 None] Lock "cinder-c539b55b-0d8c-4f65-a0c5-810547f4ba79-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:58:19 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-06b36a92-ba82-4ede-8d1b-4663d61ffd42 tempest-VolumesTransfersV357Test-59777751 None] Acquiring lock "cinder-quobyte-c539b55b-0d8c-4f65-a0c5-810547f4ba79" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:58:19 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-06b36a92-ba82-4ede-8d1b-4663d61ffd42 tempest-VolumesTransfersV357Test-59777751 None] Lock "cinder-quobyte-c539b55b-0d8c-4f65-a0c5-810547f4ba79" acquired by "delete_volume" :: waited 0.022s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:58:19 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc18f49-2104-40db-b15a-baebcaa106ad]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-06b36a92-ba82-4ede-8d1b-4663d61ffd42 tempest-VolumesTransfersV357Test-59777751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c539b55b-0d8c-4f65-a0c5-810547f4ba79 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:19 devstack sudo[85243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c539b55b-0d8c-4f65-a0c5-810547f4ba79 Apr 16 22:58:19 devstack sudo[85243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:20 devstack sudo[85234]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-be71dfc9-d4fc-435d-89ce-7d0c44ec3020 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7.d4092c04-79cd-4dab-8f2d-802e7a1d3dfc" returned: 0 in 2.168s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:20 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-be71dfc9-d4fc-435d-89ce-7d0c44ec3020 tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-d4092c04-79cd-4dab-8f2d-802e7a1d3dfc" released by "_delete_snapshot" :: held 4.299s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:58:20 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-be71dfc9-d4fc-435d-89ce-7d0c44ec3020 tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-e7bed109-39bd-40ae-8694-a36011b26ff7" released by "delete_snapshot" :: held 4.317s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:58:20 devstack sudo[85196]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a40d978-5816-44c0-ae87-90566b314550 tempest-VolumesActionsTest-148448383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 /opt/stack/data/cinder/conversion/57104bb9-81ac-49ad-802f-92c92256ccc0.temp_image.a7f34672-eab8-4cb7-80fe-2c0dd9f55d750csbd0l2.img" returned: 0 in 3.212s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:20 devstack cinder-volume[81971]: WARNING cinder.quota [None req-be71dfc9-d4fc-435d-89ce-7d0c44ec3020 tempest-GroupSnapshotsTest-545220734 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1885825555 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1885825555, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:58:20 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[151aaf1a-2e7d-45c6-b4d7-9e79f1a3d792]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a40d978-5816-44c0-ae87-90566b314550 tempest-VolumesActionsTest-148448383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:20 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-be71dfc9-d4fc-435d-89ce-7d0c44ec3020 tempest-GroupSnapshotsTest-545220734 None] Created reservations ['c53034d0-9d7e-411c-8116-fe798304a6d8', '3271895f-f690-4589-84ae-d1354c60b65b', '23085834-b105-4515-a322-db3696fec3fe', 'cf32f89d-9f73-4735-9566-2af15684dd0a'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:58:20 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-be71dfc9-d4fc-435d-89ce-7d0c44ec3020 tempest-GroupSnapshotsTest-545220734 None] group_snapshot 1d41aa6b-d6b7-4665-b2dc-169d638af19a: deleted successfully Apr 16 22:58:20 devstack sudo[85247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 Apr 16 22:58:20 devstack sudo[85247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:20 devstack sudo[85243]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-06b36a92-ba82-4ede-8d1b-4663d61ffd42 tempest-VolumesTransfersV357Test-59777751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c539b55b-0d8c-4f65-a0c5-810547f4ba79" returned: 0 in 1.099s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-06b36a92-ba82-4ede-8d1b-4663d61ffd42 tempest-VolumesTransfersV357Test-59777751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c539b55b-0d8c-4f65-a0c5-810547f4ba79 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:20 devstack sudo[85252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c539b55b-0d8c-4f65-a0c5-810547f4ba79 Apr 16 22:58:20 devstack sudo[85252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:20 devstack sudo[85247]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a40d978-5816-44c0-ae87-90566b314550 tempest-VolumesActionsTest-148448383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0" returned: 0 in 0.669s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:20 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-2a40d978-5816-44c0-ae87-90566b314550 tempest-VolumesActionsTest-148448383 None] Image conversion details: src /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0, size 1024.00 MB, duration 3.21 sec, destination /opt/stack/data/cinder/conversion/57104bb9-81ac-49ad-802f-92c92256ccc0.temp_image.a7f34672-eab8-4cb7-80fe-2c0dd9f55d750csbd0l2.img {{(pid=81971) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:58:20 devstack cinder-volume[81971]: INFO cinder.image.image_utils [None req-2a40d978-5816-44c0-ae87-90566b314550 tempest-VolumesActionsTest-148448383 None] Converted 1024.00 MB image at 318.78 MB/s Apr 16 22:58:20 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-2a40d978-5816-44c0-ae87-90566b314550 tempest-VolumesActionsTest-148448383 None] a7f34672-eab8-4cb7-80fe-2c0dd9f55d75 was raw, no need to convert to raw {{(pid=81971) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 16 22:58:21 devstack sudo[85252]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-06b36a92-ba82-4ede-8d1b-4663d61ffd42 tempest-VolumesTransfersV357Test-59777751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c539b55b-0d8c-4f65-a0c5-810547f4ba79" returned: 0 in 0.574s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-06b36a92-ba82-4ede-8d1b-4663d61ffd42 tempest-VolumesTransfersV357Test-59777751 None] Lock "cinder-quobyte-c539b55b-0d8c-4f65-a0c5-810547f4ba79" released by "delete_volume" :: held 1.797s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:58:21 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-06b36a92-ba82-4ede-8d1b-4663d61ffd42 tempest-VolumesTransfersV357Test-59777751 None] Created reservations ['0d8a7a10-544e-4f47-bb89-369749a525f9', 'b5e38a74-7e44-455a-aa69-226bd2c8eb62', 'a0695ae3-602a-4791-8c74-5400973a2fb4', 'ac0f3f31-8080-49b0-96bc-e7de5a5d0334'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:58:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-06b36a92-ba82-4ede-8d1b-4663d61ffd42 tempest-VolumesTransfersV357Test-59777751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-06b36a92-ba82-4ede-8d1b-4663d61ffd42 tempest-VolumesTransfersV357Test-59777751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-06b36a92-ba82-4ede-8d1b-4663d61ffd42 tempest-VolumesTransfersV357Test-59777751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:58:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-06b36a92-ba82-4ede-8d1b-4663d61ffd42 tempest-VolumesTransfersV357Test-59777751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:58:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-06b36a92-ba82-4ede-8d1b-4663d61ffd42 tempest-VolumesTransfersV357Test-59777751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-06b36a92-ba82-4ede-8d1b-4663d61ffd42 tempest-VolumesTransfersV357Test-59777751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:21 devstack sudo[85279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:58:21 devstack sudo[85279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ec7182aa-86dc-4220-8dd9-22de27b1a42a tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "cinder-quobyte-e7bed109-39bd-40ae-8694-a36011b26ff7" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:58:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ec7182aa-86dc-4220-8dd9-22de27b1a42a tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-e7bed109-39bd-40ae-8694-a36011b26ff7" acquired by "delete_volume" :: waited 0.016s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:58:21 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a4ad56-f163-4453-8942-e6e2ab407a64]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ec7182aa-86dc-4220-8dd9-22de27b1a42a tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:21 devstack sudo[85281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7 Apr 16 22:58:21 devstack sudo[85281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:21 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:58:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Flow 'volume_create_manager' (f86cd95d-c94f-4236-9448-6c02b7410d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:58:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa1fe470-6f73-4808-b9b8-e9c4f44eb8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa1fe470-6f73-4808-b9b8-e9c4f44eb8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1896980542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756ab2ac-74c3-44f1-a602-308615d2be1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3c8026888a4331bb6d6bbee020c628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:58:22Z,use_quota=True,user_id='9ecbabdc875140afb041fcb7bffbffa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (459c1e6b-8fd5-4b70-9ac2-50839ea28282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (459c1e6b-8fd5-4b70-9ac2-50839ea28282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c28a2b-707f-4113-a008-1a9a8bdb9f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:22 devstack sudo[85279]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c28a2b-707f-4113-a008-1a9a8bdb9f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '756ab2ac-74c3-44f1-a602-308615d2be1d', 'volume_name': 'volume-756ab2ac-74c3-44f1-a602-308615d2be1d', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58fa7aeb-79ae-43db-9067-156128483534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58fa7aeb-79ae-43db-9067-156128483534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc55cc8-eec1-48d0-81c2-8f0cfeb22a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:22 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Volume 756ab2ac-74c3-44f1-a602-308615d2be1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-756ab2ac-74c3-44f1-a602-308615d2be1d', 'volume_size': 1} Apr 16 22:58:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-06b36a92-ba82-4ede-8d1b-4663d61ffd42 tempest-VolumesTransfersV357Test-59777751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.845s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:22 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-06b36a92-ba82-4ede-8d1b-4663d61ffd42 tempest-VolumesTransfersV357Test-59777751 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:58:22 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-06b36a92-ba82-4ede-8d1b-4663d61ffd42 tempest-VolumesTransfersV357Test-59777751 None] Deleted volume successfully. Apr 16 22:58:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-06b36a92-ba82-4ede-8d1b-4663d61ffd42 tempest-VolumesTransfersV357Test-59777751 None] Lock "cinder-c539b55b-0d8c-4f65-a0c5-810547f4ba79-delete_volume" released by "delete_volume" :: held 2.988s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:58:22 devstack sudo[85281]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ec7182aa-86dc-4220-8dd9-22de27b1a42a tempest-GroupSnapshotsTest-545220734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7" returned: 0 in 0.853s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ec7182aa-86dc-4220-8dd9-22de27b1a42a tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:22 devstack sudo[85290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7 Apr 16 22:58:22 devstack sudo[85290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:22 devstack sudo[85290]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ec7182aa-86dc-4220-8dd9-22de27b1a42a tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e7bed109-39bd-40ae-8694-a36011b26ff7" returned: 0 in 0.569s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ec7182aa-86dc-4220-8dd9-22de27b1a42a tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-e7bed109-39bd-40ae-8694-a36011b26ff7" released by "delete_volume" :: held 1.472s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:58:23 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-ec7182aa-86dc-4220-8dd9-22de27b1a42a tempest-GroupSnapshotsTest-545220734 None] Created reservations ['b3300fea-3fd6-47d9-a05c-582e652a05e3'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:58:23 devstack cinder-volume[81971]: WARNING cinder.db.sqlalchemy.api [None req-ec7182aa-86dc-4220-8dd9-22de27b1a42a tempest-GroupSnapshotsTest-545220734 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1885825555'] Apr 16 22:58:23 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-ec7182aa-86dc-4220-8dd9-22de27b1a42a tempest-GroupSnapshotsTest-545220734 None] Created reservations ['9f81d9e9-e9cb-4499-a7e0-8e8bb878f865', '46854941-68d2-4afa-87cb-1f6a1f4dab24', '5daee829-2edc-4da0-b013-533cad8196be', 'c6fe7534-c3ed-43a2-9919-7ce7d9608477'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:58:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ec7182aa-86dc-4220-8dd9-22de27b1a42a tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ec7182aa-86dc-4220-8dd9-22de27b1a42a tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ec7182aa-86dc-4220-8dd9-22de27b1a42a tempest-GroupSnapshotsTest-545220734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:58:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ec7182aa-86dc-4220-8dd9-22de27b1a42a tempest-GroupSnapshotsTest-545220734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:58:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ec7182aa-86dc-4220-8dd9-22de27b1a42a tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ec7182aa-86dc-4220-8dd9-22de27b1a42a tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:23 devstack sudo[85293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:58:23 devstack sudo[85293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:23 devstack sudo[85293]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ec7182aa-86dc-4220-8dd9-22de27b1a42a tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.498s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:23 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-ec7182aa-86dc-4220-8dd9-22de27b1a42a tempest-GroupSnapshotsTest-545220734 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:58:23 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-ec7182aa-86dc-4220-8dd9-22de27b1a42a tempest-GroupSnapshotsTest-545220734 None] Delete group completed successfully. Apr 16 22:58:24 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-4904f09d-9964-469c-87bf-0fb9f06ab8ce tempest-GroupSnapshotsTest-545220734 None] Group tempest-GroupSnapshotsTest-Group-1091606082: creating Apr 16 22:58:24 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-4904f09d-9964-469c-87bf-0fb9f06ab8ce tempest-GroupSnapshotsTest-545220734 None] Group tempest-GroupSnapshotsTest-Group-1091606082: created successfully Apr 16 22:58:24 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-4904f09d-9964-469c-87bf-0fb9f06ab8ce tempest-GroupSnapshotsTest-545220734 None] Create group completed successfully. Apr 16 22:58:25 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:58:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Flow 'volume_create_manager' (a6387c08-622c-49f8-9acf-ed745f32a779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:58:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415f75f9-7512-492b-a9a6-06ab49b2dab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (415f75f9-7512-492b-a9a6-06ab49b2dab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-251843128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eccd09b9-ff57-498e-ab3f-217fc6ef193e,host='devstack@QuobyteHD#QuobyteHD',id=61c24947-8466-43da-92bd-fe47b44f2024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d1e231403084f8bafa7279cc624180f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:58:26Z,use_quota=True,user_id='046548c5a7df409691cc08d2a6ba412b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5afdc92f-141b-43bb-8be0-2869761f951f),volume_type_id=5afdc92f-141b-43bb-8be0-2869761f951f)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179842eb-019a-4622-92a9-cb214f3bf34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179842eb-019a-4622-92a9-cb214f3bf34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13bfde44-7bde-426a-9904-0aff0763bbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13bfde44-7bde-426a-9904-0aff0763bbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61c24947-8466-43da-92bd-fe47b44f2024', 'volume_name': 'volume-61c24947-8466-43da-92bd-fe47b44f2024', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (804083f9-a4d0-4443-b7a1-8f9ed95eb6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (804083f9-a4d0-4443-b7a1-8f9ed95eb6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db33da7-18ce-4e3e-9f9b-c66d0fe3d0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:25 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Volume 61c24947-8466-43da-92bd-fe47b44f2024: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61c24947-8466-43da-92bd-fe47b44f2024', 'volume_size': 1} Apr 16 22:58:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2a40d978-5816-44c0-ae87-90566b314550 tempest-VolumesActionsTest-148448383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 17.019s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a40d978-5816-44c0-ae87-90566b314550 tempest-VolumesActionsTest-148448383 None] Uploaded volume to glance image-id: a7f34672-eab8-4cb7-80fe-2c0dd9f55d75. {{(pid=81971) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 16 22:58:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.880s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:32 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1896980542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756ab2ac-74c3-44f1-a602-308615d2be1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e3c8026888a4331bb6d6bbee020c628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:58:22Z,use_quota=True,user_id='9ecbabdc875140afb041fcb7bffbffa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:58:32 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Creating volume 756ab2ac-74c3-44f1-a602-308615d2be1d {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:58:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:32 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:58:32 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:58:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:32 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:58:32 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:58:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-756ab2ac-74c3-44f1-a602-308615d2be1d 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:32 devstack sudo[85327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-756ab2ac-74c3-44f1-a602-308615d2be1d 1073741824 Apr 16 22:58:32 devstack sudo[85327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:32 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-2a40d978-5816-44c0-ae87-90566b314550 tempest-VolumesActionsTest-148448383 None] Copy volume to image completed successfully. Apr 16 22:58:33 devstack sudo[85327]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-756ab2ac-74c3-44f1-a602-308615d2be1d 1073741824" returned: 0 in 0.543s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-756ab2ac-74c3-44f1-a602-308615d2be1d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:33 devstack sudo[85332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-756ab2ac-74c3-44f1-a602-308615d2be1d Apr 16 22:58:33 devstack sudo[85332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:33 devstack sudo[85332]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-756ab2ac-74c3-44f1-a602-308615d2be1d" returned: 0 in 0.463s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:58:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.316s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eccd09b9-ff57-498e-ab3f-217fc6ef193e,created_at=2026-04-16T20:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-251843128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eccd09b9-ff57-498e-ab3f-217fc6ef193e,host='devstack@QuobyteHD#QuobyteHD',id=61c24947-8466-43da-92bd-fe47b44f2024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d1e231403084f8bafa7279cc624180f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:58:26Z,use_quota=True,user_id='046548c5a7df409691cc08d2a6ba412b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5afdc92f-141b-43bb-8be0-2869761f951f),volume_type_id=5afdc92f-141b-43bb-8be0-2869761f951f)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:58:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Creating volume 61c24947-8466-43da-92bd-fe47b44f2024 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:58:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:58:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:58:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:58:33 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:58:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc55cc8-eec1-48d0-81c2-8f0cfeb22a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-756ab2ac-74c3-44f1-a602-308615d2be1d', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:34 devstack sudo[85335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024 1073741824 Apr 16 22:58:34 devstack sudo[85335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2536c709-7890-41cd-a667-15dce3d3a2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:34 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Volume volume-756ab2ac-74c3-44f1-a602-308615d2be1d (756ab2ac-74c3-44f1-a602-308615d2be1d): created successfully Apr 16 22:58:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2536c709-7890-41cd-a667-15dce3d3a2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Flow 'volume_create_manager' (f86cd95d-c94f-4236-9448-6c02b7410d5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:58:34 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-cf034637-094f-44cc-9af1-b8a606d670f5 tempest-VolumesTransfersV357Test-134390671 None] Created volume successfully. Apr 16 22:58:34 devstack sudo[85335]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024 1073741824" returned: 0 in 0.512s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:34 devstack sudo[85340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024 Apr 16 22:58:34 devstack sudo[85340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:35 devstack sudo[85340]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024" returned: 0 in 0.552s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.230s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0db33da7-18ce-4e3e-9f9b-c66d0fe3d0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61c24947-8466-43da-92bd-fe47b44f2024', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da211b22-e6c7-4906-8a62-838493f32f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60d8641-7c6a-450f-999c-966c30553393]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:35 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Volume volume-61c24947-8466-43da-92bd-fe47b44f2024 (61c24947-8466-43da-92bd-fe47b44f2024): created successfully Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da211b22-e6c7-4906-8a62-838493f32f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Flow 'volume_create_manager' (a6387c08-622c-49f8-9acf-ed745f32a779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bb0d55f9-2632-48da-b13c-585e99373e30 tempest-VolumesTransfersV357Test-59777751 None] Acquiring lock "cinder-756ab2ac-74c3-44f1-a602-308615d2be1d-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:58:35 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-637f5151-2b05-4818-a80a-0dff19e465e3 tempest-GroupSnapshotsTest-545220734 None] Created volume successfully. Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bb0d55f9-2632-48da-b13c-585e99373e30 tempest-VolumesTransfersV357Test-59777751 None] Lock "cinder-756ab2ac-74c3-44f1-a602-308615d2be1d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bb0d55f9-2632-48da-b13c-585e99373e30 tempest-VolumesTransfersV357Test-59777751 None] Acquiring lock "cinder-quobyte-756ab2ac-74c3-44f1-a602-308615d2be1d" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:58:35 devstack sudo[85343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 Apr 16 22:58:35 devstack sudo[85343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bb0d55f9-2632-48da-b13c-585e99373e30 tempest-VolumesTransfersV357Test-59777751 None] Lock "cinder-quobyte-756ab2ac-74c3-44f1-a602-308615d2be1d" acquired by "delete_volume" :: waited 0.022s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e38c53a-18fa-4a4c-863a-3d8ca1a0c955]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bb0d55f9-2632-48da-b13c-585e99373e30 tempest-VolumesTransfersV357Test-59777751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-756ab2ac-74c3-44f1-a602-308615d2be1d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:35 devstack sudo[85345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-756ab2ac-74c3-44f1-a602-308615d2be1d Apr 16 22:58:35 devstack sudo[85345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Flow 'volume_create_manager' (55771c46-6c54-4667-a798-2efeb4a2ccdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (378a23b6-f0a3-459f-8f2d-7c8e9f3965c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (378a23b6-f0a3-459f-8f2d-7c8e9f3965c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1442928257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eccd09b9-ff57-498e-ab3f-217fc6ef193e,host='devstack@QuobyteHD#QuobyteHD',id=e1878edd-fd1f-4869-a398-a3b634ccc7aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d1e231403084f8bafa7279cc624180f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:58:36Z,use_quota=True,user_id='046548c5a7df409691cc08d2a6ba412b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5afdc92f-141b-43bb-8be0-2869761f951f),volume_type_id=5afdc92f-141b-43bb-8be0-2869761f951f)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49bb200d-9c13-402c-885d-a512a6ba5d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49bb200d-9c13-402c-885d-a512a6ba5d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f9b8a4-0b6a-4590-b901-0ffb507b7d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02f9b8a4-0b6a-4590-b901-0ffb507b7d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1878edd-fd1f-4869-a398-a3b634ccc7aa', 'volume_name': 'volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6522ce6-b669-4222-846c-c5f871453946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6522ce6-b669-4222-846c-c5f871453946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e32e874-b5c6-4760-8805-4b7d30dde052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:35 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Volume e1878edd-fd1f-4869-a398-a3b634ccc7aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa', 'volume_size': 1} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:35 devstack sudo[85343]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0" returned: 0 in 0.831s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[2131875c-ea25-4d23-9558-e364ab719d06]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:35 devstack sudo[85345]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bb0d55f9-2632-48da-b13c-585e99373e30 tempest-VolumesTransfersV357Test-59777751 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-756ab2ac-74c3-44f1-a602-308615d2be1d" returned: 0 in 0.724s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bb0d55f9-2632-48da-b13c-585e99373e30 tempest-VolumesTransfersV357Test-59777751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-756ab2ac-74c3-44f1-a602-308615d2be1d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:35 devstack sudo[85354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-756ab2ac-74c3-44f1-a602-308615d2be1d Apr 16 22:58:35 devstack sudo[85354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:36 devstack sudo[85353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 Apr 16 22:58:36 devstack sudo[85353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:36 devstack sudo[85353]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0" returned: 0 in 0.555s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 /opt/stack/data/cinder/conversion/57104bb9-81ac-49ad-802f-92c92256ccc0.temp_image.69236d8e-6fb5-4f65-b3a3-a1e8466a9604gtbwthy2.img {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:36 devstack sudo[85362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 /opt/stack/data/cinder/conversion/57104bb9-81ac-49ad-802f-92c92256ccc0.temp_image.69236d8e-6fb5-4f65-b3a3-a1e8466a9604gtbwthy2.img Apr 16 22:58:36 devstack sudo[85362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:36 devstack sudo[85354]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bb0d55f9-2632-48da-b13c-585e99373e30 tempest-VolumesTransfersV357Test-59777751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-756ab2ac-74c3-44f1-a602-308615d2be1d" returned: 0 in 0.671s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:36 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bb0d55f9-2632-48da-b13c-585e99373e30 tempest-VolumesTransfersV357Test-59777751 None] Lock "cinder-quobyte-756ab2ac-74c3-44f1-a602-308615d2be1d" released by "delete_volume" :: held 1.430s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:58:36 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-bb0d55f9-2632-48da-b13c-585e99373e30 tempest-VolumesTransfersV357Test-59777751 None] Created reservations ['d0156055-33f8-4f87-8884-2e4a50f0909f', 'c9d6c2e9-79fc-4d8d-8dc2-dfe690318e58', 'e4742ece-d2f3-4bda-8ec8-24b71aeb71ef', '578341e3-1c90-470c-b5f1-18fc7b843f39'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:58:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bb0d55f9-2632-48da-b13c-585e99373e30 tempest-VolumesTransfersV357Test-59777751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bb0d55f9-2632-48da-b13c-585e99373e30 tempest-VolumesTransfersV357Test-59777751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-bb0d55f9-2632-48da-b13c-585e99373e30 tempest-VolumesTransfersV357Test-59777751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:58:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-bb0d55f9-2632-48da-b13c-585e99373e30 tempest-VolumesTransfersV357Test-59777751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:58:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bb0d55f9-2632-48da-b13c-585e99373e30 tempest-VolumesTransfersV357Test-59777751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bb0d55f9-2632-48da-b13c-585e99373e30 tempest-VolumesTransfersV357Test-59777751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:36 devstack sudo[85364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:58:36 devstack sudo[85364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:38 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:58:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Flow 'volume_create_manager' (c21e822b-62dc-42f1-8c0e-fca3375f4546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:58:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd4f571-00c6-4752-bb40-c4efcc6192d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:38 devstack sudo[85364]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dd4f571-00c6-4752-bb40-c4efcc6192d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:58:38Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45cf112e-9ac7-4cf3-8e02-75aabdac3202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f387930380394a13a1dce51e052b4c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:58:38Z,use_quota=True,user_id='d0f6a64aba2841608a6df0569904d699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8127dab-ebeb-4a44-a5d5-643234b05db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8127dab-ebeb-4a44-a5d5-643234b05db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2476e5d0-6511-422f-b798-af389bd9740d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:39 devstack cinder-volume[81971]: DEBUG cinder.image.glance [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Creating Keystone auth plugin from conf {{(pid=81971) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 22:58:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bb0d55f9-2632-48da-b13c-585e99373e30 tempest-VolumesTransfersV357Test-59777751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 2.314s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:39 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-bb0d55f9-2632-48da-b13c-585e99373e30 tempest-VolumesTransfersV357Test-59777751 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:58:39 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-bb0d55f9-2632-48da-b13c-585e99373e30 tempest-VolumesTransfersV357Test-59777751 None] Deleted volume successfully. Apr 16 22:58:39 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bb0d55f9-2632-48da-b13c-585e99373e30 tempest-VolumesTransfersV357Test-59777751 None] Lock "cinder-756ab2ac-74c3-44f1-a602-308615d2be1d-delete_volume" released by "delete_volume" :: held 3.980s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:58:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2476e5d0-6511-422f-b798-af389bd9740d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '45cf112e-9ac7-4cf3-8e02-75aabdac3202', 'volume_name': 'volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202', 'volume_size': 1, 'image_id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '70c7e2479fd847c6b5fabb2201f59bd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'created_at': datetime.datetime(2026, 4, 16, 20, 51, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 20, 51, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67495a41-e815-4605-9a97-9da14c5c26a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67495a41-e815-4605-9a97-9da14c5c26a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c823e575-d224-4888-8c22-2ee306dedd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:39 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Volume 45cf112e-9ac7-4cf3-8e02-75aabdac3202: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202', 'volume_size': 1, 'image_id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '70c7e2479fd847c6b5fabb2201f59bd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'created_at': datetime.datetime(2026, 4, 16, 20, 51, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 20, 51, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 22:58:39 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Trying to clone 45cf112e-9ac7-4cf3-8e02-75aabdac3202 from image f3c20cd6-f75b-4471-a89e-2a8c84f8b824 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'metadata': {}}]). {{(pid=81971) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 22:58:40 devstack sudo[85362]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:40 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_w50n7zeddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81971) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 22:58:40 devstack cinder-volume[81971]: INFO cinder.image.image_utils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Image download 20.69 MB at 20.69 MB/s Apr 16 22:58:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 /opt/stack/data/cinder/conversion/57104bb9-81ac-49ad-802f-92c92256ccc0.temp_image.69236d8e-6fb5-4f65-b3a3-a1e8466a9604gtbwthy2.img" returned: 0 in 3.836s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:40 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7350f85-cd5d-400d-93e3-ddef049757c2]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:40 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[baca32b8-09de-43db-8c9c-01cfbe607e52]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_w50n7zeddevstack@QuobyteHD {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:40 devstack sudo[85399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 Apr 16 22:58:40 devstack sudo[85399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:40 devstack sudo[85400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_w50n7zeddevstack@QuobyteHD Apr 16 22:58:40 devstack sudo[85400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:41 devstack sudo[85399]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0" returned: 0 in 0.692s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:41 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] Image conversion details: src /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0, size 1024.00 MB, duration 3.84 sec, destination /opt/stack/data/cinder/conversion/57104bb9-81ac-49ad-802f-92c92256ccc0.temp_image.69236d8e-6fb5-4f65-b3a3-a1e8466a9604gtbwthy2.img {{(pid=81971) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:58:41 devstack cinder-volume[81971]: INFO cinder.image.image_utils [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] Converted 1024.00 MB image at 266.88 MB/s Apr 16 22:58:41 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] 69236d8e-6fb5-4f65-b3a3-a1e8466a9604 was raw, converting to qcow2 {{(pid=81971) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 16 22:58:41 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f54c23-d78c-4ae1-90af-a144bc17626d]: (4, 'raw') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/57104bb9-81ac-49ad-802f-92c92256ccc0.temp_image.69236d8e-6fb5-4f65-b3a3-a1e8466a9604gtbwthy2.img {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:41 devstack sudo[85406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/57104bb9-81ac-49ad-802f-92c92256ccc0.temp_image.69236d8e-6fb5-4f65-b3a3-a1e8466a9604gtbwthy2.img Apr 16 22:58:41 devstack sudo[85406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:41 devstack sudo[85400]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_w50n7zeddevstack@QuobyteHD" returned: 0 in 0.829s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:41 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Temporary image f3c20cd6-f75b-4471-a89e-2a8c84f8b824 is fetched for user d0f6a64aba2841608a6df0569904d699. {{(pid=81971) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 22:58:41 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[656a4d34-d701-4692-845d-2be5eb8de613]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_w50n7zeddevstack@QuobyteHD {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:41 devstack sudo[85411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_w50n7zeddevstack@QuobyteHD Apr 16 22:58:41 devstack sudo[85411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:41 devstack sudo[85411]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_w50n7zeddevstack@QuobyteHD" returned: 0 in 0.601s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:41 devstack sudo[85406]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/57104bb9-81ac-49ad-802f-92c92256ccc0.temp_image.69236d8e-6fb5-4f65-b3a3-a1e8466a9604gtbwthy2.img" returned: 0 in 0.829s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/57104bb9-81ac-49ad-802f-92c92256ccc0.temp_image.69236d8e-6fb5-4f65-b3a3-a1e8466a9604gtbwthy2.img {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:42 devstack sudo[85418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/57104bb9-81ac-49ad-802f-92c92256ccc0.temp_image.69236d8e-6fb5-4f65-b3a3-a1e8466a9604gtbwthy2.img Apr 16 22:58:42 devstack sudo[85418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:42 devstack sudo[85418]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/57104bb9-81ac-49ad-802f-92c92256ccc0.temp_image.69236d8e-6fb5-4f65-b3a3-a1e8466a9604gtbwthy2.img" returned: 1 in 0.614s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/57104bb9-81ac-49ad-802f-92c92256ccc0.temp_image.69236d8e-6fb5-4f65-b3a3-a1e8466a9604gtbwthy2.img' failed. Not Retrying. {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:58:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/57104bb9-81ac-49ad-802f-92c92256ccc0.temp_image.69236d8e-6fb5-4f65-b3a3-a1e8466a9604gtbwthy2.img /opt/stack/data/cinder/conversion/vol_upload_ih0h6gkq {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:42 devstack sudo[85424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/57104bb9-81ac-49ad-802f-92c92256ccc0.temp_image.69236d8e-6fb5-4f65-b3a3-a1e8466a9604gtbwthy2.img /opt/stack/data/cinder/conversion/vol_upload_ih0h6gkq Apr 16 22:58:42 devstack sudo[85424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:43 devstack sudo[85424]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/57104bb9-81ac-49ad-802f-92c92256ccc0.temp_image.69236d8e-6fb5-4f65-b3a3-a1e8466a9604gtbwthy2.img /opt/stack/data/cinder/conversion/vol_upload_ih0h6gkq" returned: 0 in 0.601s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:43 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] Image conversion details: src /opt/stack/data/cinder/conversion/57104bb9-81ac-49ad-802f-92c92256ccc0.temp_image.69236d8e-6fb5-4f65-b3a3-a1e8466a9604gtbwthy2.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ih0h6gkq {{(pid=81971) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:58:43 devstack cinder-volume[81971]: INFO cinder.image.image_utils [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 16 22:58:43 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[4915e6bb-10ea-4cbd-af56-42b816dcd693]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ih0h6gkq {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:43 devstack sudo[85433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ih0h6gkq Apr 16 22:58:43 devstack sudo[85433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:43 devstack sudo[85433]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ih0h6gkq" returned: 0 in 0.610s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:44 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:58:44 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Flow 'volume_create_manager' (1866863d-179e-494c-afcb-47619b0c91be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:58:44 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1b2ea4-79ed-49b6-a619-abee12111a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:44 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1b2ea4-79ed-49b6-a619-abee12111a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1737168306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=630656dd-d650-4fcc-a490-211876d73862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e3ee11fcaad4f04997c96917a3ee8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:58:45Z,use_quota=True,user_id='0b34df5d2b20455cb43315bc79a957d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:44 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2621c4-1ccc-4f79-9bc1-dfa2a8f91625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:44 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b2621c4-1ccc-4f79-9bc1-dfa2a8f91625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:44 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3992b205-c4be-443c-b42d-7005ced074e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:44 devstack cinder-volume[81971]: DEBUG cinder.image.glance [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Creating Keystone auth plugin from conf {{(pid=81971) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 22:58:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.813s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:44 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] Uploaded volume to glance image-id: 69236d8e-6fb5-4f65-b3a3-a1e8466a9604. {{(pid=81971) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 16 22:58:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.009s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:44 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eccd09b9-ff57-498e-ab3f-217fc6ef193e,created_at=2026-04-16T20:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1442928257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eccd09b9-ff57-498e-ab3f-217fc6ef193e,host='devstack@QuobyteHD#QuobyteHD',id=e1878edd-fd1f-4869-a398-a3b634ccc7aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d1e231403084f8bafa7279cc624180f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:58:36Z,use_quota=True,user_id='046548c5a7df409691cc08d2a6ba412b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5afdc92f-141b-43bb-8be0-2869761f951f),volume_type_id=5afdc92f-141b-43bb-8be0-2869761f951f)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:58:44 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Creating volume e1878edd-fd1f-4869-a398-a3b634ccc7aa {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:58:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:44 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:58:44 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:58:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:44 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:58:44 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:58:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:44 devstack sudo[85455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa 1073741824 Apr 16 22:58:44 devstack sudo[85455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:44 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-a47ff88d-1451-414f-a95e-040bb8bc0ba6 tempest-VolumesActionsTest-148448383 None] Copy volume to image completed successfully. Apr 16 22:58:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3992b205-c4be-443c-b42d-7005ced074e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '630656dd-d650-4fcc-a490-211876d73862', 'volume_name': 'volume-630656dd-d650-4fcc-a490-211876d73862', 'volume_size': 1, 'image_id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '70c7e2479fd847c6b5fabb2201f59bd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'created_at': datetime.datetime(2026, 4, 16, 20, 51, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 20, 51, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb38eca-0961-476a-beb1-bea94f33beaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb38eca-0961-476a-beb1-bea94f33beaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ea0301c-ce9b-4ca7-a992-67dad0057651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:45 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Volume 630656dd-d650-4fcc-a490-211876d73862: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-630656dd-d650-4fcc-a490-211876d73862', 'volume_size': 1, 'image_id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '70c7e2479fd847c6b5fabb2201f59bd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'created_at': datetime.datetime(2026, 4, 16, 20, 51, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 20, 51, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 22:58:45 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Trying to clone 630656dd-d650-4fcc-a490-211876d73862 from image f3c20cd6-f75b-4471-a89e-2a8c84f8b824 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'metadata': {}}]). {{(pid=81971) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 22:58:45 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_5zp7ynuxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81971) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 22:58:45 devstack cinder-volume[81971]: INFO cinder.image.image_utils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Image download 20.69 MB at 20.69 MB/s Apr 16 22:58:45 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2585b1c-d635-4281-967f-bf1ca1f84bcf]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_5zp7ynuxdevstack@QuobyteHD {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:45 devstack sudo[85459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_5zp7ynuxdevstack@QuobyteHD Apr 16 22:58:45 devstack sudo[85459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:45 devstack sudo[85455]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa 1073741824" returned: 0 in 0.758s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:45 devstack sudo[85463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa Apr 16 22:58:45 devstack sudo[85463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:45 devstack sudo[85459]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_5zp7ynuxdevstack@QuobyteHD" returned: 0 in 0.592s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:45 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Temporary image f3c20cd6-f75b-4471-a89e-2a8c84f8b824 is fetched for user 0b34df5d2b20455cb43315bc79a957d4. {{(pid=81971) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[0326f53b-1fc1-4bb8-8b70-1c89faed813a]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_5zp7ynuxdevstack@QuobyteHD {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b2e89e8a-2ed6-462b-873f-9e25e4888a42 tempest-VolumesActionsTest-148448383 None] Acquiring lock "cinder-57104bb9-81ac-49ad-802f-92c92256ccc0-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b2e89e8a-2ed6-462b-873f-9e25e4888a42 tempest-VolumesActionsTest-148448383 None] Lock "cinder-57104bb9-81ac-49ad-802f-92c92256ccc0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b2e89e8a-2ed6-462b-873f-9e25e4888a42 tempest-VolumesActionsTest-148448383 None] Acquiring lock "cinder-quobyte-57104bb9-81ac-49ad-802f-92c92256ccc0" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b2e89e8a-2ed6-462b-873f-9e25e4888a42 tempest-VolumesActionsTest-148448383 None] Lock "cinder-quobyte-57104bb9-81ac-49ad-802f-92c92256ccc0" acquired by "delete_volume" :: waited 0.008s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b3b5ed-f75d-4a1c-8dc3-84b5cbdb2222]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b2e89e8a-2ed6-462b-873f-9e25e4888a42 tempest-VolumesActionsTest-148448383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:46 devstack sudo[85468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_5zp7ynuxdevstack@QuobyteHD Apr 16 22:58:46 devstack sudo[85468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:46 devstack sudo[85469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 Apr 16 22:58:46 devstack sudo[85469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:46 devstack sudo[85463]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa" returned: 0 in 0.680s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.486s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:58:38Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45cf112e-9ac7-4cf3-8e02-75aabdac3202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f387930380394a13a1dce51e052b4c17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:58:38Z,use_quota=True,user_id='d0f6a64aba2841608a6df0569904d699',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Creating volume 45cf112e-9ac7-4cf3-8e02-75aabdac3202 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:58:46 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e32e874-b5c6-4760-8805-4b7d30dde052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ac6b66-237c-4def-802a-2224e62da185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:46 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Volume volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa (e1878edd-fd1f-4869-a398-a3b634ccc7aa): created successfully Apr 16 22:58:46 devstack sudo[85479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 1073741824 Apr 16 22:58:46 devstack sudo[85479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ac6b66-237c-4def-802a-2224e62da185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Flow 'volume_create_manager' (55771c46-6c54-4667-a798-2efeb4a2ccdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:58:46 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-a189cf56-16bc-4b71-b635-7ce6cf311b13 tempest-GroupSnapshotsTest-545220734 None] Created volume successfully. Apr 16 22:58:46 devstack sudo[85469]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b2e89e8a-2ed6-462b-873f-9e25e4888a42 tempest-VolumesActionsTest-148448383 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0" returned: 0 in 0.524s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b2e89e8a-2ed6-462b-873f-9e25e4888a42 tempest-VolumesActionsTest-148448383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:46 devstack sudo[85468]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_5zp7ynuxdevstack@QuobyteHD" returned: 0 in 0.671s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:46 devstack sudo[85487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0 Apr 16 22:58:46 devstack sudo[85487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:47 devstack sudo[85479]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 1073741824" returned: 0 in 0.679s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:47 devstack sudo[85492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 Apr 16 22:58:47 devstack sudo[85492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:47 devstack sudo[85487]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b2e89e8a-2ed6-462b-873f-9e25e4888a42 tempest-VolumesActionsTest-148448383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-57104bb9-81ac-49ad-802f-92c92256ccc0" returned: 0 in 0.544s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b2e89e8a-2ed6-462b-873f-9e25e4888a42 tempest-VolumesActionsTest-148448383 None] Lock "cinder-quobyte-57104bb9-81ac-49ad-802f-92c92256ccc0" released by "delete_volume" :: held 1.091s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-b2e89e8a-2ed6-462b-873f-9e25e4888a42 tempest-VolumesActionsTest-148448383 None] Created reservations ['bea96f4c-89de-4022-a8fb-a5f39cc2a51b', 'eddc1412-43b5-4eb0-9c7c-8862d98b5772', 'e0a3e3b2-627c-4307-8556-8260ba1deceb', '5c273247-abbd-43c0-ac4a-8ef664d3c748'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b2e89e8a-2ed6-462b-873f-9e25e4888a42 tempest-VolumesActionsTest-148448383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b2e89e8a-2ed6-462b-873f-9e25e4888a42 tempest-VolumesActionsTest-148448383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b2e89e8a-2ed6-462b-873f-9e25e4888a42 tempest-VolumesActionsTest-148448383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b2e89e8a-2ed6-462b-873f-9e25e4888a42 tempest-VolumesActionsTest-148448383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b2e89e8a-2ed6-462b-873f-9e25e4888a42 tempest-VolumesActionsTest-148448383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b2e89e8a-2ed6-462b-873f-9e25e4888a42 tempest-VolumesActionsTest-148448383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:47 devstack sudo[85495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:58:47 devstack sudo[85495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:47 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-4bdb714a-bd97-40e0-9e9f-c11f0379f14e tempest-GroupSnapshotsTest-545220734 None] Update group completed successfully. Apr 16 22:58:47 devstack sudo[85492]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202" returned: 0 in 0.616s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.018s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1737168306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=630656dd-d650-4fcc-a490-211876d73862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e3ee11fcaad4f04997c96917a3ee8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:58:45Z,use_quota=True,user_id='0b34df5d2b20455cb43315bc79a957d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Creating volume 630656dd-d650-4fcc-a490-211876d73862 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:58:47 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:47 devstack sudo[85499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 1073741824 Apr 16 22:58:47 devstack sudo[85499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG cinder.volume.volume_utils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Attempting download of f3c20cd6-f75b-4471-a89e-2a8c84f8b824 ((None, [{'url': 'file:///opt/stack/data/glance/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'metadata': {}}])) to volume 45cf112e-9ac7-4cf3-8e02-75aabdac3202. {{(pid=81971) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5e8286-4add-422f-b197-666ac395d560]: (4, 'raw') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_mgiqls10 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:47 devstack sudo[85495]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b2e89e8a-2ed6-462b-873f-9e25e4888a42 tempest-VolumesActionsTest-148448383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.536s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-b2e89e8a-2ed6-462b-873f-9e25e4888a42 tempest-VolumesActionsTest-148448383 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:58:47 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-b2e89e8a-2ed6-462b-873f-9e25e4888a42 tempest-VolumesActionsTest-148448383 None] Deleted volume successfully. Apr 16 22:58:47 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b2e89e8a-2ed6-462b-873f-9e25e4888a42 tempest-VolumesActionsTest-148448383 None] Lock "cinder-57104bb9-81ac-49ad-802f-92c92256ccc0-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:58:47 devstack sudo[85501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_mgiqls10 Apr 16 22:58:47 devstack sudo[85501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:48 devstack sudo[85501]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_mgiqls10" returned: 0 in 0.625s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_mgiqls10 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:48 devstack sudo[85499]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 1073741824" returned: 0 in 0.772s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:48 devstack sudo[85508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_mgiqls10 Apr 16 22:58:48 devstack sudo[85508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:48 devstack sudo[85510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 Apr 16 22:58:48 devstack sudo[85510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:48 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-f5ac5a3e-9255-4af0-b3ce-794d40d8254e tempest-GroupSnapshotsTest-545220734 None] Update group completed successfully. Apr 16 22:58:49 devstack sudo[85508]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_mgiqls10" returned: 1 in 0.708s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_mgiqls10' failed. Not Retrying. {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:58:49 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[7961c865-798c-4bf0-a8b1-0a4c3aaddbf4]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_w50n7zeddevstack@QuobyteHD {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:49 devstack sudo[85510]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862" returned: 0 in 0.628s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:58:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:49 devstack cinder-volume[81971]: DEBUG cinder.volume.volume_utils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Attempting download of f3c20cd6-f75b-4471-a89e-2a8c84f8b824 ((None, [{'url': 'file:///opt/stack/data/glance/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'metadata': {}}])) to volume 630656dd-d650-4fcc-a490-211876d73862. {{(pid=81971) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 16 22:58:49 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[76afc43d-c34f-4620-afa9-e065c6cb2045]: (4, 'raw') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:49 devstack sudo[85515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_w50n7zeddevstack@QuobyteHD Apr 16 22:58:49 devstack sudo[85515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_1atk28a_ {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:49 devstack sudo[85517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_1atk28a_ Apr 16 22:58:49 devstack sudo[85517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:49 devstack sudo[85515]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_w50n7zeddevstack@QuobyteHD" returned: 0 in 0.698s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:49 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] f3c20cd6-f75b-4471-a89e-2a8c84f8b824 was qcow2, converting to raw {{(pid=81971) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 22:58:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_w50n7zeddevstack@QuobyteHD /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:49 devstack sudo[85525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_w50n7zeddevstack@QuobyteHD /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 Apr 16 22:58:49 devstack sudo[85525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:49 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-9f352aff-9670-43fb-95ac-f86e08316bf8 tempest-GroupSnapshotsTest-545220734 None] Update group completed successfully. Apr 16 22:58:50 devstack sudo[85517]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_1atk28a_" returned: 0 in 0.762s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_1atk28a_ {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:50 devstack sudo[85527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_1atk28a_ Apr 16 22:58:50 devstack sudo[85527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:50 devstack sudo[85527]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_1atk28a_" returned: 1 in 0.682s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_1atk28a_' failed. Not Retrying. {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:58:50 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[9091e605-bb63-4245-b78a-03dca938370b]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_5zp7ynuxdevstack@QuobyteHD {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:50 devstack sudo[85538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_5zp7ynuxdevstack@QuobyteHD Apr 16 22:58:50 devstack sudo[85538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:51 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-f4cc5531-e06e-4525-ab5b-5f4b3ce07940 tempest-GroupSnapshotsTest-545220734 None] Update group completed successfully. Apr 16 22:58:51 devstack sudo[85525]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_w50n7zeddevstack@QuobyteHD /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202" returned: 0 in 1.781s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:51 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_w50n7zeddevstack@QuobyteHD, size 112.00 MB, duration 1.78 sec, destination /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 {{(pid=81971) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:58:51 devstack cinder-volume[81971]: INFO cinder.image.image_utils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Converted 112.00 MB image at 62.85 MB/s Apr 16 22:58:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:51 devstack sudo[85545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 1G Apr 16 22:58:51 devstack sudo[85545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:51 devstack sudo[85538]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_5zp7ynuxdevstack@QuobyteHD" returned: 0 in 1.061s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:51 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] f3c20cd6-f75b-4471-a89e-2a8c84f8b824 was qcow2, converting to raw {{(pid=81971) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 22:58:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_5zp7ynuxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:51 devstack sudo[85547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_5zp7ynuxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 Apr 16 22:58:51 devstack sudo[85547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:51 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] GroupSnapshot f81d6003-33b8-4247-812f-04dcea593d41: creating. Apr 16 22:58:51 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] Group snapshot f81d6003-33b8-4247-812f-04dcea593d41: creating. {{(pid=81971) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 16 22:58:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:51 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] Creating offline snapshot 1111af34-cd19-482d-958a-089c1e9a0add of volume 61c24947-8466-43da-92bd-fe47b44f2024 {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:58:51 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62ad1ad-f978-486e-b11a-863f7183b7be]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:52 devstack sudo[85549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024 Apr 16 22:58:52 devstack sudo[85549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:52 devstack sudo[85545]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 1G" returned: 0 in 0.913s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:52 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[c47dff98-0c9e-46cd-bcc9-fa0d901b85f7]: (4, 'raw') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:52 devstack sudo[85561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 Apr 16 22:58:52 devstack sudo[85561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:53 devstack sudo[85549]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024" returned: 0 in 1.217s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.1111af34-cd19-482d-958a-089c1e9a0add 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:53 devstack sudo[85547]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_5zp7ynuxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862" returned: 0 in 1.451s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:53 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_5zp7ynuxdevstack@QuobyteHD, size 112.00 MB, duration 1.45 sec, destination /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 {{(pid=81971) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:58:53 devstack cinder-volume[81971]: INFO cinder.image.image_utils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Converted 112.00 MB image at 77.08 MB/s Apr 16 22:58:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:53 devstack sudo[85566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.1111af34-cd19-482d-958a-089c1e9a0add 1G Apr 16 22:58:53 devstack sudo[85566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:53 devstack sudo[85568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 1G Apr 16 22:58:53 devstack sudo[85568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:53 devstack sudo[85561]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202" returned: 0 in 1.117s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:53 devstack sudo[85572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 Apr 16 22:58:53 devstack sudo[85572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:54 devstack sudo[85568]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 1G" returned: 0 in 0.835s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:54 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70d9a68-0ab1-438d-b436-efd85dee0f16]: (4, 'raw') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:54 devstack sudo[85566]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.1111af34-cd19-482d-958a-089c1e9a0add 1G" returned: 0 in 0.970s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61c24947-8466-43da-92bd-fe47b44f2024 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.1111af34-cd19-482d-958a-089c1e9a0add {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:54 devstack sudo[85581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61c24947-8466-43da-92bd-fe47b44f2024 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.1111af34-cd19-482d-958a-089c1e9a0add Apr 16 22:58:54 devstack sudo[85581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:54 devstack sudo[85580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 Apr 16 22:58:54 devstack sudo[85580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:54 devstack sudo[85572]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202" returned: 1 in 0.906s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202' failed. Not Retrying. {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:58:54 devstack cinder-volume[81971]: DEBUG cinder.volume.volume_utils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Downloaded image f3c20cd6-f75b-4471-a89e-2a8c84f8b824 ((None, [{'url': 'file:///opt/stack/data/glance/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'metadata': {}}])) to volume 45cf112e-9ac7-4cf3-8e02-75aabdac3202 successfully. {{(pid=81971) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 16 22:58:54 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Temporary image f3c20cd6-f75b-4471-a89e-2a8c84f8b824 for user d0f6a64aba2841608a6df0569904d699 is deleted. {{(pid=81971) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 22:58:54 devstack cinder-volume[81971]: DEBUG cinder.volume.volume_utils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Marking volume 45cf112e-9ac7-4cf3-8e02-75aabdac3202 as bootable. {{(pid=81971) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 16 22:58:54 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Copying metadata from image f3c20cd6-f75b-4471-a89e-2a8c84f8b824 to 45cf112e-9ac7-4cf3-8e02-75aabdac3202. {{(pid=81971) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 22:58:54 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Creating volume glance metadata for volume 45cf112e-9ac7-4cf3-8e02-75aabdac3202 backed by image f3c20cd6-f75b-4471-a89e-2a8c84f8b824 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81971) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 22:58:54 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c823e575-d224-4888-8c22-2ee306dedd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202', 'volume_size': 1, 'image_id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '70c7e2479fd847c6b5fabb2201f59bd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'created_at': datetime.datetime(2026, 4, 16, 20, 51, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 20, 51, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:54 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6abe74-cc32-4bf6-ad94-c7e1abd572a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:54 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Volume volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 (45cf112e-9ac7-4cf3-8e02-75aabdac3202): created successfully Apr 16 22:58:54 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6abe74-cc32-4bf6-ad94-c7e1abd572a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:54 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Flow 'volume_create_manager' (c21e822b-62dc-42f1-8c0e-fca3375f4546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:58:54 devstack sudo[85580]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862" returned: 0 in 0.777s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:54 devstack cinder-volume[81971]: INFO cinder.volume.manager [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-64819f4b-b367-4fec-a918-c60640ffa957 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Created volume successfully. Apr 16 22:58:54 devstack sudo[85581]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61c24947-8466-43da-92bd-fe47b44f2024 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.1111af34-cd19-482d-958a-089c1e9a0add" returned: 0 in 0.877s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:54 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.1111af34-cd19-482d-958a-089c1e9a0add is being set with open permissions: ugo+rw: NotImplementedError Apr 16 22:58:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.1111af34-cd19-482d-958a-089c1e9a0add {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:55 devstack sudo[85593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.1111af34-cd19-482d-958a-089c1e9a0add Apr 16 22:58:55 devstack sudo[85593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:55 devstack sudo[85592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 Apr 16 22:58:55 devstack sudo[85592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:55 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:58:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Flow 'volume_create_manager' (24118c22-cb69-4949-bba8-4dda9804e81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:58:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b229762-172e-4153-b92c-ff1d67b9315b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b229762-172e-4153-b92c-ff1d67b9315b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1437541007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a19f6ccc-f06b-406d-9f18-224c8e791860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aebe2f5eaed74acdb71aeda744fcd602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:58:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:58:55Z,use_quota=True,user_id='1e343017694f44088ed21e6c6ca2ac54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5859d51c-b3c0-4115-bd9e-1ff39fb7afb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5859d51c-b3c0-4115-bd9e-1ff39fb7afb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (595373d5-fdfc-472e-8bb8-8d3eade76106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (595373d5-fdfc-472e-8bb8-8d3eade76106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a19f6ccc-f06b-406d-9f18-224c8e791860', 'volume_name': 'volume-a19f6ccc-f06b-406d-9f18-224c8e791860', 'volume_size': 2}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7772361b-8d84-4223-bd83-1a3090fcdf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7772361b-8d84-4223-bd83-1a3090fcdf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef83c127-1fd7-4f78-82d3-13283b2f8905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:55 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Volume a19f6ccc-f06b-406d-9f18-224c8e791860: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a19f6ccc-f06b-406d-9f18-224c8e791860', 'volume_size': 2} Apr 16 22:58:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:55 devstack sudo[85593]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.1111af34-cd19-482d-958a-089c1e9a0add" returned: 0 in 0.523s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:55 devstack sudo[85597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.info Apr 16 22:58:55 devstack sudo[85597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:55 devstack sudo[85592]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862" returned: 1 in 0.907s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862' failed. Not Retrying. {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:58:55 devstack cinder-volume[81971]: DEBUG cinder.volume.volume_utils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Downloaded image f3c20cd6-f75b-4471-a89e-2a8c84f8b824 ((None, [{'url': 'file:///opt/stack/data/glance/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'metadata': {}}])) to volume 630656dd-d650-4fcc-a490-211876d73862 successfully. {{(pid=81971) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 16 22:58:55 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Temporary image f3c20cd6-f75b-4471-a89e-2a8c84f8b824 for user 0b34df5d2b20455cb43315bc79a957d4 is deleted. {{(pid=81971) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 22:58:55 devstack cinder-volume[81971]: DEBUG cinder.volume.volume_utils [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Marking volume 630656dd-d650-4fcc-a490-211876d73862 as bootable. {{(pid=81971) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 16 22:58:55 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Copying metadata from image f3c20cd6-f75b-4471-a89e-2a8c84f8b824 to 630656dd-d650-4fcc-a490-211876d73862. {{(pid=81971) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 22:58:55 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Creating volume glance metadata for volume 630656dd-d650-4fcc-a490-211876d73862 backed by image f3c20cd6-f75b-4471-a89e-2a8c84f8b824 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81971) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 22:58:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ea0301c-ce9b-4ca7-a992-67dad0057651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-630656dd-d650-4fcc-a490-211876d73862', 'volume_size': 1, 'image_id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '70c7e2479fd847c6b5fabb2201f59bd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'created_at': datetime.datetime(2026, 4, 16, 20, 51, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 20, 51, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6e29db-1bde-4c41-ba8e-f8b037fb2295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:58:55 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Volume volume-630656dd-d650-4fcc-a490-211876d73862 (630656dd-d650-4fcc-a490-211876d73862): created successfully Apr 16 22:58:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6e29db-1bde-4c41-ba8e-f8b037fb2295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:58:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Flow 'volume_create_manager' (1866863d-179e-494c-afcb-47619b0c91be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:58:55 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-3e748f23-b19e-4508-8bec-91d931567a36 tempest-VolumesExtendTest-11966567 None] Created volume successfully. Apr 16 22:58:56 devstack sudo[85597]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.info" returned: 0 in 0.516s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:56 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 22:58:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:56 devstack sudo[85603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.info Apr 16 22:58:56 devstack sudo[85603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:56 devstack sudo[85603]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.info" returned: 0 in 0.484s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.649s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] Creating offline snapshot e8d5a70f-ecaa-4ced-930c-b9a273e68dd1 of volume e1878edd-fd1f-4869-a398-a3b634ccc7aa {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:58:56 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53cb937-b342-4609-a59f-a094d062124a]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:58:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:56 devstack sudo[85606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa Apr 16 22:58:56 devstack sudo[85606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9f941113-1722-42be-b44f-c22683277a0c tempest-VolumesExtendTest-11966567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:57 devstack sudo[85606]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa" returned: 0 in 0.547s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.e8d5a70f-ecaa-4ced-930c-b9a273e68dd1 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:57 devstack sudo[85611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.e8d5a70f-ecaa-4ced-930c-b9a273e68dd1 1G Apr 16 22:58:57 devstack sudo[85611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-d3ffc52e-bc84-43fd-a4ef-3315888f0df7 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:57 devstack sudo[85611]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.e8d5a70f-ecaa-4ced-930c-b9a273e68dd1 1G" returned: 0 in 0.837s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.e8d5a70f-ecaa-4ced-930c-b9a273e68dd1 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:57 devstack sudo[85658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.e8d5a70f-ecaa-4ced-930c-b9a273e68dd1 Apr 16 22:58:57 devstack sudo[85658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:58 devstack sudo[85658]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.e8d5a70f-ecaa-4ced-930c-b9a273e68dd1" returned: 0 in 0.508s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:58 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.e8d5a70f-ecaa-4ced-930c-b9a273e68dd1 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 22:58:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.e8d5a70f-ecaa-4ced-930c-b9a273e68dd1 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:58 devstack sudo[85663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.e8d5a70f-ecaa-4ced-930c-b9a273e68dd1 Apr 16 22:58:58 devstack sudo[85663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:58 devstack sudo[85663]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.e8d5a70f-ecaa-4ced-930c-b9a273e68dd1" returned: 0 in 0.470s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:58 devstack sudo[85666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.info Apr 16 22:58:58 devstack sudo[85666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:59 devstack sudo[85666]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.info" returned: 0 in 0.476s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:59 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 22:58:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:59 devstack sudo[85669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.info Apr 16 22:58:59 devstack sudo[85669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:59 devstack sudo[85669]: pam_unix(sudo:session): session closed for user root Apr 16 22:58:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.info" returned: 0 in 0.422s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:58:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.318s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.477s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:59 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:58:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1437541007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a19f6ccc-f06b-406d-9f18-224c8e791860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aebe2f5eaed74acdb71aeda744fcd602',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:58:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:58:55Z,use_quota=True,user_id='1e343017694f44088ed21e6c6ca2ac54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:58:59 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Creating volume a19f6ccc-f06b-406d-9f18-224c8e791860 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:58:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:58:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:58:59 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:58:59 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:58:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:58:59 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:58:59 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:58:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a19f6ccc-f06b-406d-9f18-224c8e791860 2147483648 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:58:59 devstack sudo[85672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a19f6ccc-f06b-406d-9f18-224c8e791860 2147483648 Apr 16 22:58:59 devstack sudo[85672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:58:59 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-f9925d4e-44fe-409b-861f-8f5ef1508420 tempest-GroupSnapshotsTest-545220734 None] group_snapshot f81d6003-33b8-4247-812f-04dcea593d41: created successfully Apr 16 22:59:00 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] group_snapshot f81d6003-33b8-4247-812f-04dcea593d41: deleting Apr 16 22:59:00 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] group_snapshot f81d6003-33b8-4247-812f-04dcea593d41: deleting {{(pid=81971) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 16 22:59:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "cinder-quobyte-61c24947-8466-43da-92bd-fe47b44f2024" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-61c24947-8466-43da-92bd-fe47b44f2024" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "cinder-quobyte-1111af34-cd19-482d-958a-089c1e9a0add" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-1111af34-cd19-482d-958a-089c1e9a0add" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:00 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Deleting offline snapshot 1111af34-cd19-482d-958a-089c1e9a0add of volume 61c24947-8466-43da-92bd-fe47b44f2024 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:59:00 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] snapshot_file for this snap is: volume-61c24947-8466-43da-92bd-fe47b44f2024.1111af34-cd19-482d-958a-089c1e9a0add {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:59:00 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e00c33-36cf-417d-9f99-261f52b8acb1]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.1111af34-cd19-482d-958a-089c1e9a0add {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:00 devstack sudo[85678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.1111af34-cd19-482d-958a-089c1e9a0add Apr 16 22:59:00 devstack sudo[85678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:00 devstack sudo[85672]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a19f6ccc-f06b-406d-9f18-224c8e791860 2147483648" returned: 0 in 0.744s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a19f6ccc-f06b-406d-9f18-224c8e791860 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:00 devstack sudo[85680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a19f6ccc-f06b-406d-9f18-224c8e791860 Apr 16 22:59:00 devstack sudo[85680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:00 devstack sudo[85678]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.1111af34-cd19-482d-958a-089c1e9a0add" returned: 0 in 0.575s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:00 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61c24947-8466-43da-92bd-fe47b44f2024(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:59:00 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e091326-03a5-45a5-9fd7-501390db436b]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:01 devstack sudo[85685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024 Apr 16 22:59:01 devstack sudo[85685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:01 devstack sudo[85680]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a19f6ccc-f06b-406d-9f18-224c8e791860" returned: 0 in 0.479s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:01 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:59:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9f941113-1722-42be-b44f-c22683277a0c tempest-VolumesExtendTest-11966567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 4.178s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:01 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef83c127-1fd7-4f78-82d3-13283b2f8905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a19f6ccc-f06b-406d-9f18-224c8e791860', 'volume_size': 2}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:01 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9dc289-c42a-4ebd-956e-f3f68de6a497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:01 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Volume volume-a19f6ccc-f06b-406d-9f18-224c8e791860 (a19f6ccc-f06b-406d-9f18-224c8e791860): created successfully Apr 16 22:59:01 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9dc289-c42a-4ebd-956e-f3f68de6a497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:01 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Flow 'volume_create_manager' (24118c22-cb69-4949-bba8-4dda9804e81f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:59:01 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-aa042abf-6681-4b40-bf57-fd8241fc2acf tempest-VolumesCloneNegativeTest-606755434 None] Created volume successfully. Apr 16 22:59:01 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[211d6a66-a23f-477e-bd0a-1d6344cb6206]: (4, 'raw') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9f941113-1722-42be-b44f-c22683277a0c tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:01 devstack sudo[85688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 Apr 16 22:59:01 devstack sudo[85688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:01 devstack sudo[85685]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024" returned: 0 in 0.547s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.1111af34-cd19-482d-958a-089c1e9a0add {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:01 devstack sudo[85693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.1111af34-cd19-482d-958a-089c1e9a0add Apr 16 22:59:01 devstack sudo[85693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:01 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ab0056d1-c17c-40fd-97a3-6a8d44b64d36 tempest-VolumesCloneNegativeTest-606755434 None] Acquiring lock "cinder-a19f6ccc-f06b-406d-9f18-224c8e791860-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:01 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ab0056d1-c17c-40fd-97a3-6a8d44b64d36 tempest-VolumesCloneNegativeTest-606755434 None] Lock "cinder-a19f6ccc-f06b-406d-9f18-224c8e791860-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:01 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ab0056d1-c17c-40fd-97a3-6a8d44b64d36 tempest-VolumesCloneNegativeTest-606755434 None] Acquiring lock "cinder-quobyte-a19f6ccc-f06b-406d-9f18-224c8e791860" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:01 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ab0056d1-c17c-40fd-97a3-6a8d44b64d36 tempest-VolumesCloneNegativeTest-606755434 None] Lock "cinder-quobyte-a19f6ccc-f06b-406d-9f18-224c8e791860" acquired by "delete_volume" :: waited 0.009s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:01 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[93672fee-3a00-473b-be28-f86fcecd6c18]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ab0056d1-c17c-40fd-97a3-6a8d44b64d36 tempest-VolumesCloneNegativeTest-606755434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a19f6ccc-f06b-406d-9f18-224c8e791860 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:01 devstack sudo[85688]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9f941113-1722-42be-b44f-c22683277a0c tempest-VolumesExtendTest-11966567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862" returned: 0 in 0.663s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9f941113-1722-42be-b44f-c22683277a0c tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:01 devstack sudo[85697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a19f6ccc-f06b-406d-9f18-224c8e791860 Apr 16 22:59:01 devstack sudo[85697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:01 devstack sudo[85698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 Apr 16 22:59:01 devstack sudo[85698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:02 devstack sudo[85693]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.1111af34-cd19-482d-958a-089c1e9a0add" returned: 0 in 0.661s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.1111af34-cd19-482d-958a-089c1e9a0add {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:02 devstack sudo[85705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.1111af34-cd19-482d-958a-089c1e9a0add Apr 16 22:59:02 devstack sudo[85705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:02 devstack sudo[85697]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ab0056d1-c17c-40fd-97a3-6a8d44b64d36 tempest-VolumesCloneNegativeTest-606755434 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a19f6ccc-f06b-406d-9f18-224c8e791860" returned: 0 in 0.764s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ab0056d1-c17c-40fd-97a3-6a8d44b64d36 tempest-VolumesCloneNegativeTest-606755434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a19f6ccc-f06b-406d-9f18-224c8e791860 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:02 devstack sudo[85713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a19f6ccc-f06b-406d-9f18-224c8e791860 Apr 16 22:59:02 devstack sudo[85713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:02 devstack sudo[85698]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9f941113-1722-42be-b44f-c22683277a0c tempest-VolumesExtendTest-11966567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862" returned: 1 in 0.879s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9f941113-1722-42be-b44f-c22683277a0c tempest-VolumesExtendTest-11966567 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862' failed. Not Retrying. {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:59:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9f941113-1722-42be-b44f-c22683277a0c tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 2G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9f941113-1722-42be-b44f-c22683277a0c tempest-VolumesExtendTest-11966567 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 2G" returned: 0 in 0.085s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9f941113-1722-42be-b44f-c22683277a0c tempest-VolumesExtendTest-11966567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.685s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-d3ffc52e-bc84-43fd-a4ef-3315888f0df7 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.949s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:02 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:SELECT=122,cinder:UPDATE=103,cinder:INSERT=28,cinder:DELETE=6 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:59:02 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff31edb3-e6f7-4246-bd05-57c1e7b2bdc5]: (4, 'raw') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-d3ffc52e-bc84-43fd-a4ef-3315888f0df7 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:02 devstack sudo[85705]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024.1111af34-cd19-482d-958a-089c1e9a0add" returned: 0 in 0.705s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-1111af34-cd19-482d-958a-089c1e9a0add" released by "_delete_snapshot" :: held 2.551s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-61c24947-8466-43da-92bd-fe47b44f2024" released by "delete_snapshot" :: held 2.573s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:02 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-9f941113-1722-42be-b44f-c22683277a0c tempest-VolumesExtendTest-11966567 None] Extend volume completed successfully. Apr 16 22:59:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "cinder-quobyte-e1878edd-fd1f-4869-a398-a3b634ccc7aa" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:02 devstack sudo[85719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 Apr 16 22:59:02 devstack sudo[85719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-e1878edd-fd1f-4869-a398-a3b634ccc7aa" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "cinder-quobyte-e8d5a70f-ecaa-4ced-930c-b9a273e68dd1" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-e8d5a70f-ecaa-4ced-930c-b9a273e68dd1" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:02 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Deleting offline snapshot e8d5a70f-ecaa-4ced-930c-b9a273e68dd1 of volume e1878edd-fd1f-4869-a398-a3b634ccc7aa {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:59:02 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] snapshot_file for this snap is: volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.e8d5a70f-ecaa-4ced-930c-b9a273e68dd1 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:59:02 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6d5111-a2cf-48e8-a843-1a2bf69f83cc]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.e8d5a70f-ecaa-4ced-930c-b9a273e68dd1 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:03 devstack sudo[85721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.e8d5a70f-ecaa-4ced-930c-b9a273e68dd1 Apr 16 22:59:03 devstack sudo[85721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:03 devstack sudo[85713]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ab0056d1-c17c-40fd-97a3-6a8d44b64d36 tempest-VolumesCloneNegativeTest-606755434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a19f6ccc-f06b-406d-9f18-224c8e791860" returned: 0 in 1.094s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:03 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ab0056d1-c17c-40fd-97a3-6a8d44b64d36 tempest-VolumesCloneNegativeTest-606755434 None] Lock "cinder-quobyte-a19f6ccc-f06b-406d-9f18-224c8e791860" released by "delete_volume" :: held 1.889s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:03 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-ab0056d1-c17c-40fd-97a3-6a8d44b64d36 tempest-VolumesCloneNegativeTest-606755434 None] Created reservations ['734a27f1-60aa-424b-b4f8-0e8a244ae436', '6ae33d7a-b1a8-4340-8d05-acb1d74ea1d0', '1f7f7b7d-f74c-4b04-aa98-3b9cf0e84b13', 'df0bf3ca-6525-454c-95c2-f0f0cd9137e5'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:59:03 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-087c775e-98b4-4490-a1ce-1c8a3089aa2e tempest-VolumesExtendTest-11966567 None] Acquiring lock "cinder-630656dd-d650-4fcc-a490-211876d73862-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:03 devstack sudo[85721]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:03 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-087c775e-98b4-4490-a1ce-1c8a3089aa2e tempest-VolumesExtendTest-11966567 None] Lock "cinder-630656dd-d650-4fcc-a490-211876d73862-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.e8d5a70f-ecaa-4ced-930c-b9a273e68dd1" returned: 0 in 0.777s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:59:03 devstack sudo[85719]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-d3ffc52e-bc84-43fd-a4ef-3315888f0df7 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202" returned: 0 in 0.961s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-d3ffc52e-bc84-43fd-a4ef-3315888f0df7 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:03 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1271a61-9c7a-43b8-9b2a-95a767daa0c9]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:03 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-087c775e-98b4-4490-a1ce-1c8a3089aa2e tempest-VolumesExtendTest-11966567 None] Acquiring lock "cinder-quobyte-630656dd-d650-4fcc-a490-211876d73862" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ab0056d1-c17c-40fd-97a3-6a8d44b64d36 tempest-VolumesCloneNegativeTest-606755434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ab0056d1-c17c-40fd-97a3-6a8d44b64d36 tempest-VolumesCloneNegativeTest-606755434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ab0056d1-c17c-40fd-97a3-6a8d44b64d36 tempest-VolumesCloneNegativeTest-606755434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:59:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ab0056d1-c17c-40fd-97a3-6a8d44b64d36 tempest-VolumesCloneNegativeTest-606755434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:59:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ab0056d1-c17c-40fd-97a3-6a8d44b64d36 tempest-VolumesCloneNegativeTest-606755434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ab0056d1-c17c-40fd-97a3-6a8d44b64d36 tempest-VolumesCloneNegativeTest-606755434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:03 devstack sudo[85729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 Apr 16 22:59:03 devstack sudo[85729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:03 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-087c775e-98b4-4490-a1ce-1c8a3089aa2e tempest-VolumesExtendTest-11966567 None] Lock "cinder-quobyte-630656dd-d650-4fcc-a490-211876d73862" acquired by "delete_volume" :: waited 0.055s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:03 devstack sudo[85731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:59:03 devstack sudo[85731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:03 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf0b0dc-3fc7-4044-914c-7aa7e755aa64]: (4, 'raw') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-087c775e-98b4-4490-a1ce-1c8a3089aa2e tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:04 devstack sudo[85730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa Apr 16 22:59:04 devstack sudo[85730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:04 devstack sudo[85734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 Apr 16 22:59:04 devstack sudo[85734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:04 devstack sudo[85731]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ab0056d1-c17c-40fd-97a3-6a8d44b64d36 tempest-VolumesCloneNegativeTest-606755434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.563s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:04 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-ab0056d1-c17c-40fd-97a3-6a8d44b64d36 tempest-VolumesCloneNegativeTest-606755434 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:59:04 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-ab0056d1-c17c-40fd-97a3-6a8d44b64d36 tempest-VolumesCloneNegativeTest-606755434 None] Deleted volume successfully. Apr 16 22:59:04 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ab0056d1-c17c-40fd-97a3-6a8d44b64d36 tempest-VolumesCloneNegativeTest-606755434 None] Lock "cinder-a19f6ccc-f06b-406d-9f18-224c8e791860-delete_volume" released by "delete_volume" :: held 2.734s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:04 devstack sudo[85729]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-d3ffc52e-bc84-43fd-a4ef-3315888f0df7 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202" returned: 1 in 0.681s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-d3ffc52e-bc84-43fd-a4ef-3315888f0df7 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202' failed. Not Retrying. {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:59:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-d3ffc52e-bc84-43fd-a4ef-3315888f0df7 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.686s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-d3ffc52e-bc84-43fd-a4ef-3315888f0df7 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e', 'name': 'volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '820cb632-370f-4822-832a-aac5afcd8c04', 'enforce_multipath': True} {{(pid=81971) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 16 22:59:04 devstack sudo[85730]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:04 devstack cinder-volume[81971]: INFO cinder.volume.manager [req-aea007af-862f-4fc6-809b-28aa74bddd00 req-d3ffc52e-bc84-43fd-a4ef-3315888f0df7 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] attachment_update completed successfully. Apr 16 22:59:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa" returned: 0 in 0.722s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.e8d5a70f-ecaa-4ced-930c-b9a273e68dd1 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:04 devstack sudo[85746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.e8d5a70f-ecaa-4ced-930c-b9a273e68dd1 Apr 16 22:59:04 devstack sudo[85746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:04 devstack sudo[85734]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-087c775e-98b4-4490-a1ce-1c8a3089aa2e tempest-VolumesExtendTest-11966567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862" returned: 0 in 0.676s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-087c775e-98b4-4490-a1ce-1c8a3089aa2e tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:04 devstack sudo[85748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 Apr 16 22:59:04 devstack sudo[85748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:04 devstack cinder-volume[81971]: DEBUG oslo_service.periodic_task [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81971) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 22:59:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:59:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:59:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:04 devstack sudo[85750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:59:04 devstack sudo[85750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:05 devstack sudo[85746]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.e8d5a70f-ecaa-4ced-930c-b9a273e68dd1" returned: 0 in 0.578s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.e8d5a70f-ecaa-4ced-930c-b9a273e68dd1 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:05 devstack sudo[85756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.e8d5a70f-ecaa-4ced-930c-b9a273e68dd1 Apr 16 22:59:05 devstack sudo[85756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:05 devstack sudo[85748]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-087c775e-98b4-4490-a1ce-1c8a3089aa2e tempest-VolumesExtendTest-11966567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862" returned: 1 in 0.656s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-087c775e-98b4-4490-a1ce-1c8a3089aa2e tempest-VolumesExtendTest-11966567 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862' failed. Not Retrying. {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:59:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-087c775e-98b4-4490-a1ce-1c8a3089aa2e tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:05 devstack sudo[85761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862 Apr 16 22:59:05 devstack sudo[85761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:05 devstack sudo[85750]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.570s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:05 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:59:05 devstack sudo[85756]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa.e8d5a70f-ecaa-4ced-930c-b9a273e68dd1" returned: 0 in 0.568s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:05 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-e8d5a70f-ecaa-4ced-930c-b9a273e68dd1" released by "_delete_snapshot" :: held 2.768s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:05 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-e1878edd-fd1f-4869-a398-a3b634ccc7aa" released by "delete_snapshot" :: held 2.784s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:05 devstack cinder-volume[81971]: WARNING cinder.quota [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1115801305 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1115801305, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:59:05 devstack cinder-volume[81971]: WARNING cinder.quota [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1115801305 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1115801305, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:59:05 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Created reservations ['85e17b65-0830-40be-ae80-e18a55f34933', 'ad37b8c7-5d5b-41e8-9a39-232f2eca6506', '042f582d-f6c5-46da-8b4c-f5d27b3cf6a6', 'd3175ac3-d2c2-4898-968d-8af5fc99918e'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:59:05 devstack sudo[85761]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-087c775e-98b4-4490-a1ce-1c8a3089aa2e tempest-VolumesExtendTest-11966567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-630656dd-d650-4fcc-a490-211876d73862" returned: 0 in 0.587s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:05 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-087c775e-98b4-4490-a1ce-1c8a3089aa2e tempest-VolumesExtendTest-11966567 None] Lock "cinder-quobyte-630656dd-d650-4fcc-a490-211876d73862" released by "delete_volume" :: held 1.985s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:05 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] Created reservations ['cbad12e4-1a8c-4367-afdf-8819fbcdf9d4', 'def478eb-8305-4a50-a2d5-04c0a0ad665b', '45cd82bd-da3b-48fd-989b-96b16d189464', 'fc9c246b-e416-43ae-b7de-69ccb6915e55'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:59:05 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-185a7f07-d3fc-47d9-b463-784a49422c3e tempest-GroupSnapshotsTest-545220734 None] group_snapshot f81d6003-33b8-4247-812f-04dcea593d41: deleted successfully Apr 16 22:59:05 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-087c775e-98b4-4490-a1ce-1c8a3089aa2e tempest-VolumesExtendTest-11966567 None] Created reservations ['613560c6-8110-4d56-b201-1359b85235f6', '14866e10-de91-489c-93b6-4f795f7b5459', 'ffccf328-2ec1-4b9b-97c8-03eef3b0ddc0', '653fd6b4-0935-448a-921c-329a7c1289ba'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:59:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-087c775e-98b4-4490-a1ce-1c8a3089aa2e tempest-VolumesExtendTest-11966567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-087c775e-98b4-4490-a1ce-1c8a3089aa2e tempest-VolumesExtendTest-11966567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-087c775e-98b4-4490-a1ce-1c8a3089aa2e tempest-VolumesExtendTest-11966567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:59:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-087c775e-98b4-4490-a1ce-1c8a3089aa2e tempest-VolumesExtendTest-11966567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:59:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-087c775e-98b4-4490-a1ce-1c8a3089aa2e tempest-VolumesExtendTest-11966567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-087c775e-98b4-4490-a1ce-1c8a3089aa2e tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:06 devstack sudo[85765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:59:06 devstack sudo[85765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:06 devstack sudo[85765]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-087c775e-98b4-4490-a1ce-1c8a3089aa2e tempest-VolumesExtendTest-11966567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.536s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:06 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-087c775e-98b4-4490-a1ce-1c8a3089aa2e tempest-VolumesExtendTest-11966567 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:59:06 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-087c775e-98b4-4490-a1ce-1c8a3089aa2e tempest-VolumesExtendTest-11966567 None] Deleted volume successfully. Apr 16 22:59:06 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-087c775e-98b4-4490-a1ce-1c8a3089aa2e tempest-VolumesExtendTest-11966567 None] Lock "cinder-630656dd-d650-4fcc-a490-211876d73862-delete_volume" released by "delete_volume" :: held 2.816s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "cinder-quobyte-61c24947-8466-43da-92bd-fe47b44f2024" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-61c24947-8466-43da-92bd-fe47b44f2024" acquired by "delete_volume" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[58498f6b-6c96-4f15-9d18-c99c6b3dade4]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:07 devstack sudo[85768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024 Apr 16 22:59:07 devstack sudo[85768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Flow 'volume_create_manager' (ec3fdb56-8a09-4cb3-8c8e-22872474fb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4568d689-2cde-499a-975f-9c7a1ffcedc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4568d689-2cde-499a-975f-9c7a1ffcedc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-389672263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7b2a8b-2a53-4830-bc08-893f1d839d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e3ee11fcaad4f04997c96917a3ee8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:59:07Z,use_quota=True,user_id='0b34df5d2b20455cb43315bc79a957d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5088588a-e055-418c-9edd-35524aef7017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5088588a-e055-418c-9edd-35524aef7017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e68f0cdc-719f-43dc-a4f0-3eaa8f68a618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e68f0cdc-719f-43dc-a4f0-3eaa8f68a618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb7b2a8b-2a53-4830-bc08-893f1d839d4b', 'volume_name': 'volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed5ad8c6-8740-4956-96d1-6b4e17421fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed5ad8c6-8740-4956-96d1-6b4e17421fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e45566-3d20-44aa-9d35-cb6df2eda699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:07 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Volume fb7b2a8b-2a53-4830-bc08-893f1d839d4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b', 'volume_size': 1} Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:59:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-389672263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb7b2a8b-2a53-4830-bc08-893f1d839d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e3ee11fcaad4f04997c96917a3ee8dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:59:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:59:07Z,use_quota=True,user_id='0b34df5d2b20455cb43315bc79a957d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Creating volume fb7b2a8b-2a53-4830-bc08-893f1d839d4b {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:59:07 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:07 devstack sudo[85770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b 1073741824 Apr 16 22:59:07 devstack sudo[85770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:07 devstack sudo[85768]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024" returned: 0 in 0.609s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:07 devstack sudo[85778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024 Apr 16 22:59:07 devstack sudo[85778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:08 devstack sudo[85770]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b 1073741824" returned: 0 in 0.673s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:08 devstack sudo[85783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b Apr 16 22:59:08 devstack sudo[85783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:08 devstack sudo[85778]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-61c24947-8466-43da-92bd-fe47b44f2024" returned: 0 in 0.575s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:08 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-61c24947-8466-43da-92bd-fe47b44f2024" released by "delete_volume" :: held 1.243s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:08 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "cinder-quobyte-e1878edd-fd1f-4869-a398-a3b634ccc7aa" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:08 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-e1878edd-fd1f-4869-a398-a3b634ccc7aa" acquired by "delete_volume" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:08 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f34547d-b7aa-458e-939d-bba91c09bf85]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:08 devstack sudo[85786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa Apr 16 22:59:08 devstack sudo[85786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:08 devstack sudo[85783]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b" returned: 0 in 0.531s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:08 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:59:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e45566-3d20-44aa-9d35-cb6df2eda699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f442deca-8057-4227-94fc-1d172d2ac065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:08 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Volume volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b (fb7b2a8b-2a53-4830-bc08-893f1d839d4b): created successfully Apr 16 22:59:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f442deca-8057-4227-94fc-1d172d2ac065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Flow 'volume_create_manager' (ec3fdb56-8a09-4cb3-8c8e-22872474fb4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:59:08 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-0dc159a2-87a8-4aa1-87dd-c7f2b606b44b tempest-VolumesExtendTest-11966567 None] Created volume successfully. Apr 16 22:59:08 devstack sudo[85786]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa" returned: 0 in 0.561s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:08 devstack sudo[85792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa Apr 16 22:59:08 devstack sudo[85792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:09 devstack sudo[85792]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e1878edd-fd1f-4869-a398-a3b634ccc7aa" returned: 0 in 0.725s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:09 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-e1878edd-fd1f-4869-a398-a3b634ccc7aa" released by "delete_volume" :: held 1.331s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:09 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] Created reservations ['0d5a827d-a129-4786-a2a9-b3f46d88b45a'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:59:09 devstack cinder-volume[81971]: WARNING cinder.quota [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1115801305 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1115801305, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:59:09 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] Created reservations ['61bc6af7-ca4f-4e58-b64b-b65a3d8c86f9', '06b9bea6-db41-44ed-9465-4de9ddda3fe5', 'eec8b7ad-e750-4ea1-9f43-86913ad0c249', '808acf82-35bc-41dc-8cbd-6f91d1258ca8'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:59:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-7056e8bc-e6f6-4375-a98a-ceb446d4a118 tempest-VolumesExtendTest-11966567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-7056e8bc-e6f6-4375-a98a-ceb446d4a118 tempest-VolumesExtendTest-11966567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:09 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-7056e8bc-e6f6-4375-a98a-ceb446d4a118 tempest-VolumesExtendTest-11966567 None] Creating offline snapshot 023a404e-a6ea-4006-8460-8c6cc56f5d31 of volume fb7b2a8b-2a53-4830-bc08-893f1d839d4b {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:59:09 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[353fe394-d7a0-490c-8349-1cdd6773bf8a]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7056e8bc-e6f6-4375-a98a-ceb446d4a118 tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:09 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] Created reservations ['d65a76f8-b35b-44d8-b19b-acc8e431138e', 'efe5abf3-c946-4810-a0fb-91f262c9b2b5', '77541843-bf02-46a0-b960-76dfbd346bb4', '7a8b31d1-d068-451e-b0d5-06a1d66cdfbd'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:59:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:59:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:59:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:10 devstack sudo[85822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b Apr 16 22:59:10 devstack sudo[85822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:10 devstack sudo[85824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:59:10 devstack sudo[85824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:11 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-881ba7f0-984b-4fe0-affa-e1dee4d37f80 tempest-GroupSnapshotsTest-545220734 None] Group tempest-GroupSnapshotsTest-Group-1122033475: creating Apr 16 22:59:11 devstack sudo[85824]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.972s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:11 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:59:11 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-2740cb12-a1d9-48e0-aa4d-7acea50a5bfd tempest-GroupSnapshotsTest-545220734 None] Delete group completed successfully. Apr 16 22:59:11 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-881ba7f0-984b-4fe0-affa-e1dee4d37f80 tempest-GroupSnapshotsTest-545220734 None] Group tempest-GroupSnapshotsTest-Group-1122033475: created successfully Apr 16 22:59:11 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-881ba7f0-984b-4fe0-affa-e1dee4d37f80 tempest-GroupSnapshotsTest-545220734 None] Create group completed successfully. Apr 16 22:59:11 devstack sudo[85822]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7056e8bc-e6f6-4375-a98a-ceb446d4a118 tempest-VolumesExtendTest-11966567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b" returned: 0 in 1.363s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7056e8bc-e6f6-4375-a98a-ceb446d4a118 tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.023a404e-a6ea-4006-8460-8c6cc56f5d31 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:11 devstack sudo[85830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.023a404e-a6ea-4006-8460-8c6cc56f5d31 1G Apr 16 22:59:11 devstack sudo[85830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:12 devstack sudo[85830]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7056e8bc-e6f6-4375-a98a-ceb446d4a118 tempest-VolumesExtendTest-11966567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.023a404e-a6ea-4006-8460-8c6cc56f5d31 1G" returned: 0 in 0.922s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7056e8bc-e6f6-4375-a98a-ceb446d4a118 tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.023a404e-a6ea-4006-8460-8c6cc56f5d31 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:12 devstack sudo[85837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.023a404e-a6ea-4006-8460-8c6cc56f5d31 Apr 16 22:59:12 devstack sudo[85837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:12 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:SELECT=147,cinder:UPDATE=158,cinder:INSERT=48,cinder:DELETE=5 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 22:59:12 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:59:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Flow 'volume_create_manager' (eb5cf1bb-51bb-48cb-944d-95df6a4a29d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:59:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b4297a-a22a-4169-830a-5eb6e1eb452d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97b4297a-a22a-4169-830a-5eb6e1eb452d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-806866240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa659f96-f3f7-49fd-982c-9a1c1d3e48e0,host='devstack@QuobyteHD#QuobyteHD',id=f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d1e231403084f8bafa7279cc624180f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:59:13Z,use_quota=True,user_id='046548c5a7df409691cc08d2a6ba412b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02b7df45-4584-4091-b634-5145899dc298),volume_type_id=02b7df45-4584-4091-b634-5145899dc298)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d5460e-d7ec-4fdb-8277-474b2a9a908d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74d5460e-d7ec-4fdb-8277-474b2a9a908d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13bd1ce-1e83-4a38-bd6c-17aa8eae847f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f13bd1ce-1e83-4a38-bd6c-17aa8eae847f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666', 'volume_name': 'volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea71499-6eb1-4ca4-ac1f-71df7a2820c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea71499-6eb1-4ca4-ac1f-71df7a2820c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb58f313-58ca-4832-b9c2-0555421c4b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:13 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Volume f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666', 'volume_size': 1} Apr 16 22:59:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:13 devstack sudo[85837]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7056e8bc-e6f6-4375-a98a-ceb446d4a118 tempest-VolumesExtendTest-11966567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.023a404e-a6ea-4006-8460-8c6cc56f5d31" returned: 0 in 1.024s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:13 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-7056e8bc-e6f6-4375-a98a-ceb446d4a118 tempest-VolumesExtendTest-11966567 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.023a404e-a6ea-4006-8460-8c6cc56f5d31 is being set with open permissions: ugo+rw Apr 16 22:59:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7056e8bc-e6f6-4375-a98a-ceb446d4a118 tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.023a404e-a6ea-4006-8460-8c6cc56f5d31 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:13 devstack sudo[85843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.023a404e-a6ea-4006-8460-8c6cc56f5d31 Apr 16 22:59:13 devstack sudo[85843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:13 devstack sudo[85843]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7056e8bc-e6f6-4375-a98a-ceb446d4a118 tempest-VolumesExtendTest-11966567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.023a404e-a6ea-4006-8460-8c6cc56f5d31" returned: 0 in 0.535s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7056e8bc-e6f6-4375-a98a-ceb446d4a118 tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:13 devstack sudo[85846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.info Apr 16 22:59:13 devstack sudo[85846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:14 devstack sudo[85846]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7056e8bc-e6f6-4375-a98a-ceb446d4a118 tempest-VolumesExtendTest-11966567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.info" returned: 0 in 0.794s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:14 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-7056e8bc-e6f6-4375-a98a-ceb446d4a118 tempest-VolumesExtendTest-11966567 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.info is being set with open permissions: ugo+rw Apr 16 22:59:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7056e8bc-e6f6-4375-a98a-ceb446d4a118 tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:14 devstack sudo[85849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.info Apr 16 22:59:14 devstack sudo[85849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:15 devstack sudo[85849]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7056e8bc-e6f6-4375-a98a-ceb446d4a118 tempest-VolumesExtendTest-11966567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.info" returned: 0 in 0.606s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-7056e8bc-e6f6-4375-a98a-ceb446d4a118 tempest-VolumesExtendTest-11966567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.330s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.082s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fa659f96-f3f7-49fd-982c-9a1c1d3e48e0,created_at=2026-04-16T20:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-806866240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa659f96-f3f7-49fd-982c-9a1c1d3e48e0,host='devstack@QuobyteHD#QuobyteHD',id=f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d1e231403084f8bafa7279cc624180f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:59:13Z,use_quota=True,user_id='046548c5a7df409691cc08d2a6ba412b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02b7df45-4584-4091-b634-5145899dc298),volume_type_id=02b7df45-4584-4091-b634-5145899dc298)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:59:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Creating volume f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:59:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:59:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:59:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:59:15 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:59:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:15 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-7056e8bc-e6f6-4375-a98a-ceb446d4a118 tempest-VolumesExtendTest-11966567 None] Create snapshot completed successfully Apr 16 22:59:15 devstack sudo[85852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666 1073741824 Apr 16 22:59:15 devstack sudo[85852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:16 devstack sudo[85852]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666 1073741824" returned: 0 in 0.869s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:16 devstack sudo[85857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666 Apr 16 22:59:16 devstack sudo[85857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d8129f3c-2724-4819-9782-7c697689de5e tempest-VolumesExtendTest-11966567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:16 devstack sudo[85857]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666" returned: 0 in 0.833s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:16 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:59:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d8129f3c-2724-4819-9782-7c697689de5e tempest-VolumesExtendTest-11966567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.526s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:17 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb58f313-58ca-4832-b9c2-0555421c4b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:17 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (285d8d20-bdef-4b24-9957-2141a0ebf06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:17 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[28edaf11-88f0-4f68-a2b0-fd6989716cc7]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d8129f3c-2724-4819-9782-7c697689de5e tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:17 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Volume volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666 (f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666): created successfully Apr 16 22:59:17 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (285d8d20-bdef-4b24-9957-2141a0ebf06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:17 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Flow 'volume_create_manager' (eb5cf1bb-51bb-48cb-944d-95df6a4a29d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:59:17 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-d5723e27-c962-494b-88ff-12ed93eeb58c tempest-GroupSnapshotsTest-545220734 None] Created volume successfully. Apr 16 22:59:17 devstack sudo[85893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b Apr 16 22:59:17 devstack sudo[85893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:17 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-0383bf7a-be51-41f1-ae14-a3a802787f47 tempest-GroupSnapshotsTest-545220734 None] GroupSnapshot 68c62d61-ae29-4462-bd52-d9126b2feb07: creating. Apr 16 22:59:17 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0383bf7a-be51-41f1-ae14-a3a802787f47 tempest-GroupSnapshotsTest-545220734 None] Group snapshot 68c62d61-ae29-4462-bd52-d9126b2feb07: creating. {{(pid=81971) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 16 22:59:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0383bf7a-be51-41f1-ae14-a3a802787f47 tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:17 devstack sudo[85893]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d8129f3c-2724-4819-9782-7c697689de5e tempest-VolumesExtendTest-11966567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b" returned: 0 in 0.728s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d8129f3c-2724-4819-9782-7c697689de5e tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.023a404e-a6ea-4006-8460-8c6cc56f5d31 2G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:17 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:59:17 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Flow 'volume_create_manager' (5089a361-e9c4-46a7-aa04-44400ed26328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:59:17 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48bd6fa5-aaea-4077-9080-05db90142029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d8129f3c-2724-4819-9782-7c697689de5e tempest-VolumesExtendTest-11966567 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.023a404e-a6ea-4006-8460-8c6cc56f5d31 2G" returned: 0 in 0.197s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d8129f3c-2724-4819-9782-7c697689de5e tempest-VolumesExtendTest-11966567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.976s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0383bf7a-be51-41f1-ae14-a3a802787f47 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.315s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48bd6fa5-aaea-4077-9080-05db90142029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1220829080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95769188ca74a1086bac8f54eb7ca25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:59:18Z,use_quota=True,user_id='25a8c52cd1de40919e7c2f6c19b827e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27127dd0-3da6-4a57-8c89-45f42f354d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27127dd0-3da6-4a57-8c89-45f42f354d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f59b44-9e80-4f18-94b5-cffb20355344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f59b44-9e80-4f18-94b5-cffb20355344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8', 'volume_name': 'volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3727a2ad-0cb8-4961-a4dd-ec2c87dda96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3727a2ad-0cb8-4961-a4dd-ec2c87dda96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361fb655-be1d-47b4-899d-4c579804dcf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:18 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Volume f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8', 'volume_size': 1} Apr 16 22:59:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:18 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-0383bf7a-be51-41f1-ae14-a3a802787f47 tempest-GroupSnapshotsTest-545220734 None] Creating offline snapshot 4583066e-5c6f-4769-b0dd-c0fac6247c80 of volume f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666 {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:59:18 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd5749e-1ca3-46d2-96ec-8bb41bdbb898]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0383bf7a-be51-41f1-ae14-a3a802787f47 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:18 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-d8129f3c-2724-4819-9782-7c697689de5e tempest-VolumesExtendTest-11966567 None] Extend volume completed successfully. Apr 16 22:59:18 devstack sudo[85905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666 Apr 16 22:59:18 devstack sudo[85905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:18 devstack sudo[85905]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0383bf7a-be51-41f1-ae14-a3a802787f47 tempest-GroupSnapshotsTest-545220734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666" returned: 0 in 0.562s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0383bf7a-be51-41f1-ae14-a3a802787f47 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.4583066e-5c6f-4769-b0dd-c0fac6247c80 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:18 devstack sudo[85921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.4583066e-5c6f-4769-b0dd-c0fac6247c80 1G Apr 16 22:59:18 devstack sudo[85921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:18 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-2c1b4d1f-f7a7-4b1f-99c4-bcfb0980a0cc tempest-VolumesExtendTest-11966567 None] Acquiring lock "cinder-023a404e-a6ea-4006-8460-8c6cc56f5d31-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:18 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-2c1b4d1f-f7a7-4b1f-99c4-bcfb0980a0cc tempest-VolumesExtendTest-11966567 None] Lock "cinder-023a404e-a6ea-4006-8460-8c6cc56f5d31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:18 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-2c1b4d1f-f7a7-4b1f-99c4-bcfb0980a0cc tempest-VolumesExtendTest-11966567 None] Acquiring lock "cinder-quobyte-fb7b2a8b-2a53-4830-bc08-893f1d839d4b" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:18 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-2c1b4d1f-f7a7-4b1f-99c4-bcfb0980a0cc tempest-VolumesExtendTest-11966567 None] Lock "cinder-quobyte-fb7b2a8b-2a53-4830-bc08-893f1d839d4b" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:18 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-2c1b4d1f-f7a7-4b1f-99c4-bcfb0980a0cc tempest-VolumesExtendTest-11966567 None] Acquiring lock "cinder-quobyte-023a404e-a6ea-4006-8460-8c6cc56f5d31" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:18 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-2c1b4d1f-f7a7-4b1f-99c4-bcfb0980a0cc tempest-VolumesExtendTest-11966567 None] Lock "cinder-quobyte-023a404e-a6ea-4006-8460-8c6cc56f5d31" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:18 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-2c1b4d1f-f7a7-4b1f-99c4-bcfb0980a0cc tempest-VolumesExtendTest-11966567 None] Deleting offline snapshot 023a404e-a6ea-4006-8460-8c6cc56f5d31 of volume fb7b2a8b-2a53-4830-bc08-893f1d839d4b {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:59:18 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-2c1b4d1f-f7a7-4b1f-99c4-bcfb0980a0cc tempest-VolumesExtendTest-11966567 None] snapshot_file for this snap is: volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.023a404e-a6ea-4006-8460-8c6cc56f5d31 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:59:18 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6c3864-5aa9-4929-b68d-c29e6f05f38d]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2c1b4d1f-f7a7-4b1f-99c4-bcfb0980a0cc tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.023a404e-a6ea-4006-8460-8c6cc56f5d31 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:19 devstack sudo[85928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.023a404e-a6ea-4006-8460-8c6cc56f5d31 Apr 16 22:59:19 devstack sudo[85928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:19 devstack sudo[85921]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0383bf7a-be51-41f1-ae14-a3a802787f47 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.4583066e-5c6f-4769-b0dd-c0fac6247c80 1G" returned: 0 in 0.659s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0383bf7a-be51-41f1-ae14-a3a802787f47 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.4583066e-5c6f-4769-b0dd-c0fac6247c80 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:19 devstack sudo[85933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.4583066e-5c6f-4769-b0dd-c0fac6247c80 Apr 16 22:59:19 devstack sudo[85933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:19 devstack sudo[85928]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2c1b4d1f-f7a7-4b1f-99c4-bcfb0980a0cc tempest-VolumesExtendTest-11966567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.023a404e-a6ea-4006-8460-8c6cc56f5d31" returned: 0 in 0.548s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-2c1b4d1f-f7a7-4b1f-99c4-bcfb0980a0cc tempest-VolumesExtendTest-11966567 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:59:19 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[68db1fd3-e91c-450d-b2d6-f49776b306a1]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2c1b4d1f-f7a7-4b1f-99c4-bcfb0980a0cc tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:19 devstack sudo[85938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b Apr 16 22:59:19 devstack sudo[85938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:19 devstack sudo[85933]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0383bf7a-be51-41f1-ae14-a3a802787f47 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.4583066e-5c6f-4769-b0dd-c0fac6247c80" returned: 0 in 0.527s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:19 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-0383bf7a-be51-41f1-ae14-a3a802787f47 tempest-GroupSnapshotsTest-545220734 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.4583066e-5c6f-4769-b0dd-c0fac6247c80 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 22:59:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0383bf7a-be51-41f1-ae14-a3a802787f47 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.4583066e-5c6f-4769-b0dd-c0fac6247c80 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:19 devstack sudo[85943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.4583066e-5c6f-4769-b0dd-c0fac6247c80 Apr 16 22:59:19 devstack sudo[85943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:20 devstack sudo[85938]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2c1b4d1f-f7a7-4b1f-99c4-bcfb0980a0cc tempest-VolumesExtendTest-11966567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b" returned: 0 in 0.582s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2c1b4d1f-f7a7-4b1f-99c4-bcfb0980a0cc tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.023a404e-a6ea-4006-8460-8c6cc56f5d31 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:20 devstack sudo[85948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.023a404e-a6ea-4006-8460-8c6cc56f5d31 Apr 16 22:59:20 devstack sudo[85948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:20 devstack sudo[85943]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0383bf7a-be51-41f1-ae14-a3a802787f47 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.4583066e-5c6f-4769-b0dd-c0fac6247c80" returned: 0 in 0.526s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0383bf7a-be51-41f1-ae14-a3a802787f47 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:20 devstack sudo[85951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.info Apr 16 22:59:20 devstack sudo[85951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:20 devstack sudo[85948]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2c1b4d1f-f7a7-4b1f-99c4-bcfb0980a0cc tempest-VolumesExtendTest-11966567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.023a404e-a6ea-4006-8460-8c6cc56f5d31" returned: 0 in 0.523s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2c1b4d1f-f7a7-4b1f-99c4-bcfb0980a0cc tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.023a404e-a6ea-4006-8460-8c6cc56f5d31 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:20 devstack sudo[85956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.023a404e-a6ea-4006-8460-8c6cc56f5d31 Apr 16 22:59:20 devstack sudo[85956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:21 devstack sudo[85951]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0383bf7a-be51-41f1-ae14-a3a802787f47 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.info" returned: 0 in 0.618s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:21 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-0383bf7a-be51-41f1-ae14-a3a802787f47 tempest-GroupSnapshotsTest-545220734 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 22:59:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0383bf7a-be51-41f1-ae14-a3a802787f47 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:21 devstack sudo[85960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.info Apr 16 22:59:21 devstack sudo[85960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:21 devstack sudo[85956]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2c1b4d1f-f7a7-4b1f-99c4-bcfb0980a0cc tempest-VolumesExtendTest-11966567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b.023a404e-a6ea-4006-8460-8c6cc56f5d31" returned: 0 in 0.525s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-2c1b4d1f-f7a7-4b1f-99c4-bcfb0980a0cc tempest-VolumesExtendTest-11966567 None] Lock "cinder-quobyte-023a404e-a6ea-4006-8460-8c6cc56f5d31" released by "_delete_snapshot" :: held 2.261s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-2c1b4d1f-f7a7-4b1f-99c4-bcfb0980a0cc tempest-VolumesExtendTest-11966567 None] Lock "cinder-quobyte-fb7b2a8b-2a53-4830-bc08-893f1d839d4b" released by "delete_snapshot" :: held 2.280s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:21 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-2c1b4d1f-f7a7-4b1f-99c4-bcfb0980a0cc tempest-VolumesExtendTest-11966567 None] Created reservations ['5d88afef-243f-47d2-a905-a6364b50096a', '029e6f6d-5705-4dd9-9fa8-8b20265cb077', '6573909b-aeee-48ca-a811-7585caf2573f', '5ab61c8e-139c-4d15-b1df-a72ff0d5057f'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:59:21 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-2c1b4d1f-f7a7-4b1f-99c4-bcfb0980a0cc tempest-VolumesExtendTest-11966567 None] Delete snapshot completed successfully. Apr 16 22:59:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-2c1b4d1f-f7a7-4b1f-99c4-bcfb0980a0cc tempest-VolumesExtendTest-11966567 None] Lock "cinder-023a404e-a6ea-4006-8460-8c6cc56f5d31-delete_snapshot" released by "delete_snapshot" :: held 2.427s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:21 devstack sudo[85960]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0383bf7a-be51-41f1-ae14-a3a802787f47 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.info" returned: 0 in 0.494s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0383bf7a-be51-41f1-ae14-a3a802787f47 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.567s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.477s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1220829080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95769188ca74a1086bac8f54eb7ca25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:59:18Z,use_quota=True,user_id='25a8c52cd1de40919e7c2f6c19b827e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:59:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Creating volume f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:59:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:59:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:59:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:59:21 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:59:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:21 devstack sudo[85964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8 1073741824 Apr 16 22:59:21 devstack sudo[85964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:21 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-0383bf7a-be51-41f1-ae14-a3a802787f47 tempest-GroupSnapshotsTest-545220734 None] group_snapshot 68c62d61-ae29-4462-bd52-d9126b2feb07: created successfully Apr 16 22:59:22 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-13fe9fde-daa5-4ab1-8cd2-6854ce404fba tempest-GroupSnapshotsTest-545220734 None] group_snapshot 68c62d61-ae29-4462-bd52-d9126b2feb07: deleting Apr 16 22:59:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-851a2b15-9373-475b-86c2-944de8b1ba66 tempest-VolumesExtendTest-11966567 None] Acquiring lock "cinder-fb7b2a8b-2a53-4830-bc08-893f1d839d4b-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-851a2b15-9373-475b-86c2-944de8b1ba66 tempest-VolumesExtendTest-11966567 None] Lock "cinder-fb7b2a8b-2a53-4830-bc08-893f1d839d4b-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-13fe9fde-daa5-4ab1-8cd2-6854ce404fba tempest-GroupSnapshotsTest-545220734 None] group_snapshot 68c62d61-ae29-4462-bd52-d9126b2feb07: deleting {{(pid=81971) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 16 22:59:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-13fe9fde-daa5-4ab1-8cd2-6854ce404fba tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "cinder-quobyte-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-851a2b15-9373-475b-86c2-944de8b1ba66 tempest-VolumesExtendTest-11966567 None] Acquiring lock "cinder-quobyte-fb7b2a8b-2a53-4830-bc08-893f1d839d4b" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-13fe9fde-daa5-4ab1-8cd2-6854ce404fba tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666" acquired by "delete_snapshot" :: waited 0.042s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-13fe9fde-daa5-4ab1-8cd2-6854ce404fba tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "cinder-quobyte-4583066e-5c6f-4769-b0dd-c0fac6247c80" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-851a2b15-9373-475b-86c2-944de8b1ba66 tempest-VolumesExtendTest-11966567 None] Lock "cinder-quobyte-fb7b2a8b-2a53-4830-bc08-893f1d839d4b" acquired by "delete_volume" :: waited 0.036s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-13fe9fde-daa5-4ab1-8cd2-6854ce404fba tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-4583066e-5c6f-4769-b0dd-c0fac6247c80" acquired by "_delete_snapshot" :: waited 0.096s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:22 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-13fe9fde-daa5-4ab1-8cd2-6854ce404fba tempest-GroupSnapshotsTest-545220734 None] Deleting offline snapshot 4583066e-5c6f-4769-b0dd-c0fac6247c80 of volume f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:59:22 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-13fe9fde-daa5-4ab1-8cd2-6854ce404fba tempest-GroupSnapshotsTest-545220734 None] snapshot_file for this snap is: volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.4583066e-5c6f-4769-b0dd-c0fac6247c80 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:59:22 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a5162c-26f0-46ca-b240-7c64cbbe8741]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-851a2b15-9373-475b-86c2-944de8b1ba66 tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:22 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a1d6ec-2d44-444e-8f0a-ccde69b7753e]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-13fe9fde-daa5-4ab1-8cd2-6854ce404fba tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.4583066e-5c6f-4769-b0dd-c0fac6247c80 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:22 devstack sudo[85972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b Apr 16 22:59:22 devstack sudo[85972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:22 devstack sudo[85964]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8 1073741824" returned: 0 in 1.012s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:22 devstack sudo[85973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.4583066e-5c6f-4769-b0dd-c0fac6247c80 Apr 16 22:59:22 devstack sudo[85973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:22 devstack sudo[85976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8 Apr 16 22:59:22 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:23 devstack sudo[85972]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-851a2b15-9373-475b-86c2-944de8b1ba66 tempest-VolumesExtendTest-11966567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b" returned: 0 in 0.834s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-851a2b15-9373-475b-86c2-944de8b1ba66 tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:23 devstack sudo[86010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b Apr 16 22:59:23 devstack sudo[86010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:23 devstack sudo[85973]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-13fe9fde-daa5-4ab1-8cd2-6854ce404fba tempest-GroupSnapshotsTest-545220734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.4583066e-5c6f-4769-b0dd-c0fac6247c80" returned: 0 in 1.098s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-13fe9fde-daa5-4ab1-8cd2-6854ce404fba tempest-GroupSnapshotsTest-545220734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:59:23 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b68c0d7-e452-4d0b-bfb6-798d8082468e]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-13fe9fde-daa5-4ab1-8cd2-6854ce404fba tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:23 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8" returned: 0 in 1.259s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] <== create_volume: return (2319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:59:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.323s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:23 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (361fb655-be1d-47b4-899d-4c579804dcf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:23 devstack sudo[86014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666 Apr 16 22:59:23 devstack sudo[86014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:23 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5575c389-f568-4347-8ba5-e3e926bcfaa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:23 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Volume volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8 (f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8): created successfully Apr 16 22:59:23 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5575c389-f568-4347-8ba5-e3e926bcfaa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:23 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Flow 'volume_create_manager' (5089a361-e9c4-46a7-aa04-44400ed26328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:59:23 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-358c4b94-2322-46dc-b8e0-33aa2549e486 tempest-VolumesSnapshotTestJSON-1853747142 None] Created volume successfully. Apr 16 22:59:24 devstack sudo[86010]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-851a2b15-9373-475b-86c2-944de8b1ba66 tempest-VolumesExtendTest-11966567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb7b2a8b-2a53-4830-bc08-893f1d839d4b" returned: 0 in 1.084s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:24 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-851a2b15-9373-475b-86c2-944de8b1ba66 tempest-VolumesExtendTest-11966567 None] Lock "cinder-quobyte-fb7b2a8b-2a53-4830-bc08-893f1d839d4b" released by "delete_volume" :: held 2.049s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:24 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-851a2b15-9373-475b-86c2-944de8b1ba66 tempest-VolumesExtendTest-11966567 None] Created reservations ['003b2046-c041-4126-ace4-e426f0c31218', 'b8a63c4f-e705-433b-9c20-ef3f29f0b78d', '3ef9c2f6-3afa-463b-9406-b4b95d44db91', '0770a6a4-8bfc-4d87-85d6-2ffb4c366848'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:59:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-851a2b15-9373-475b-86c2-944de8b1ba66 tempest-VolumesExtendTest-11966567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-851a2b15-9373-475b-86c2-944de8b1ba66 tempest-VolumesExtendTest-11966567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:24 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-851a2b15-9373-475b-86c2-944de8b1ba66 tempest-VolumesExtendTest-11966567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:59:24 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-851a2b15-9373-475b-86c2-944de8b1ba66 tempest-VolumesExtendTest-11966567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:59:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-851a2b15-9373-475b-86c2-944de8b1ba66 tempest-VolumesExtendTest-11966567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-851a2b15-9373-475b-86c2-944de8b1ba66 tempest-VolumesExtendTest-11966567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:24 devstack sudo[86022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:59:24 devstack sudo[86022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:24 devstack sudo[86014]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-13fe9fde-daa5-4ab1-8cd2-6854ce404fba tempest-GroupSnapshotsTest-545220734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666" returned: 0 in 1.124s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-13fe9fde-daa5-4ab1-8cd2-6854ce404fba tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.4583066e-5c6f-4769-b0dd-c0fac6247c80 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:24 devstack sudo[86024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.4583066e-5c6f-4769-b0dd-c0fac6247c80 Apr 16 22:59:24 devstack sudo[86024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5ef32b85-2d70-4113-b52f-6a2b2c670483 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5ef32b85-2d70-4113-b52f-6a2b2c670483 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:25 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-5ef32b85-2d70-4113-b52f-6a2b2c670483 tempest-VolumesSnapshotTestJSON-1853747142 None] Creating offline snapshot 9216f37b-7836-482a-a7ee-a5f7cc297f2d of volume f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8 {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:59:25 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[3207942d-a486-404f-b313-8eb790392ca5]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5ef32b85-2d70-4113-b52f-6a2b2c670483 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:25 devstack sudo[86022]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-851a2b15-9373-475b-86c2-944de8b1ba66 tempest-VolumesExtendTest-11966567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.703s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:25 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-851a2b15-9373-475b-86c2-944de8b1ba66 tempest-VolumesExtendTest-11966567 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:59:25 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-851a2b15-9373-475b-86c2-944de8b1ba66 tempest-VolumesExtendTest-11966567 None] Deleted volume successfully. Apr 16 22:59:25 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-851a2b15-9373-475b-86c2-944de8b1ba66 tempest-VolumesExtendTest-11966567 None] Lock "cinder-fb7b2a8b-2a53-4830-bc08-893f1d839d4b-delete_volume" released by "delete_volume" :: held 3.100s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:25 devstack sudo[86027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8 Apr 16 22:59:25 devstack sudo[86027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:25 devstack sudo[86024]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-13fe9fde-daa5-4ab1-8cd2-6854ce404fba tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.4583066e-5c6f-4769-b0dd-c0fac6247c80" returned: 0 in 1.169s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-13fe9fde-daa5-4ab1-8cd2-6854ce404fba tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.4583066e-5c6f-4769-b0dd-c0fac6247c80 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:25 devstack sudo[86036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.4583066e-5c6f-4769-b0dd-c0fac6247c80 Apr 16 22:59:25 devstack sudo[86036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:26 devstack sudo[86027]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5ef32b85-2d70-4113-b52f-6a2b2c670483 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8" returned: 0 in 0.941s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5ef32b85-2d70-4113-b52f-6a2b2c670483 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.9216f37b-7836-482a-a7ee-a5f7cc297f2d 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:26 devstack sudo[86038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.9216f37b-7836-482a-a7ee-a5f7cc297f2d 1G Apr 16 22:59:26 devstack sudo[86038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:26 devstack sudo[86036]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-13fe9fde-daa5-4ab1-8cd2-6854ce404fba tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666.4583066e-5c6f-4769-b0dd-c0fac6247c80" returned: 0 in 0.924s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-13fe9fde-daa5-4ab1-8cd2-6854ce404fba tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-4583066e-5c6f-4769-b0dd-c0fac6247c80" released by "_delete_snapshot" :: held 4.460s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-13fe9fde-daa5-4ab1-8cd2-6854ce404fba tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666" released by "delete_snapshot" :: held 4.563s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:26 devstack sudo[86038]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:26 devstack cinder-volume[81971]: WARNING cinder.quota [None req-13fe9fde-daa5-4ab1-8cd2-6854ce404fba tempest-GroupSnapshotsTest-545220734 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1177747124 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1177747124, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:59:26 devstack cinder-volume[81971]: WARNING cinder.quota [None req-13fe9fde-daa5-4ab1-8cd2-6854ce404fba tempest-GroupSnapshotsTest-545220734 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1177747124 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1177747124, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:59:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5ef32b85-2d70-4113-b52f-6a2b2c670483 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.9216f37b-7836-482a-a7ee-a5f7cc297f2d 1G" returned: 0 in 0.890s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5ef32b85-2d70-4113-b52f-6a2b2c670483 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.9216f37b-7836-482a-a7ee-a5f7cc297f2d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:27 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-13fe9fde-daa5-4ab1-8cd2-6854ce404fba tempest-GroupSnapshotsTest-545220734 None] Created reservations ['7868735a-c1ad-4b22-a8a8-9deb37ef89d0', '142743f0-e549-414e-9261-922978ce1549', '62c99ef2-46a3-4400-a450-4cf2a1bd7958', '3790d297-c50c-4760-a51a-67a428a6328a'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:59:27 devstack sudo[86045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.9216f37b-7836-482a-a7ee-a5f7cc297f2d Apr 16 22:59:27 devstack sudo[86045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:27 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-13fe9fde-daa5-4ab1-8cd2-6854ce404fba tempest-GroupSnapshotsTest-545220734 None] group_snapshot 68c62d61-ae29-4462-bd52-d9126b2feb07: deleted successfully Apr 16 22:59:28 devstack sudo[86045]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5ef32b85-2d70-4113-b52f-6a2b2c670483 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.9216f37b-7836-482a-a7ee-a5f7cc297f2d" returned: 0 in 1.075s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:28 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-5ef32b85-2d70-4113-b52f-6a2b2c670483 tempest-VolumesSnapshotTestJSON-1853747142 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.9216f37b-7836-482a-a7ee-a5f7cc297f2d is being set with open permissions: ugo+rw Apr 16 22:59:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5ef32b85-2d70-4113-b52f-6a2b2c670483 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.9216f37b-7836-482a-a7ee-a5f7cc297f2d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:28 devstack sudo[86051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.9216f37b-7836-482a-a7ee-a5f7cc297f2d Apr 16 22:59:28 devstack sudo[86051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:28 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-42f92a82-fdfc-4d17-b6a8-bdda005296e8 tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "cinder-quobyte-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:28 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-42f92a82-fdfc-4d17-b6a8-bdda005296e8 tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666" acquired by "delete_volume" :: waited 0.023s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:28 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fe2ae5-136a-41ea-8c34-1eec85d1218e]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-42f92a82-fdfc-4d17-b6a8-bdda005296e8 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:28 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:59:28 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Flow 'volume_create_manager' (366553fc-7416-4891-b39b-56be880e43f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:59:28 devstack sudo[86053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666 Apr 16 22:59:28 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da50fd85-d4d0-4701-8719-f757c2bfbb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:28 devstack sudo[86053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:28 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da50fd85-d4d0-4701-8719-f757c2bfbb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-323007667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e58e9b-524b-48f6-8b4d-d5be3f8d9077,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0517ee8ba5a14e33ad487efa6fd9b492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:59:28Z,use_quota=True,user_id='12f0f8ebed774353816e2eb992d89e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:28 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04fae551-10be-41c6-8ad8-af82c35cd110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:28 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04fae551-10be-41c6-8ad8-af82c35cd110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:28 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6acfd9-77df-473c-87ff-a47452d8d572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:28 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6acfd9-77df-473c-87ff-a47452d8d572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2e58e9b-524b-48f6-8b4d-d5be3f8d9077', 'volume_name': 'volume-c2e58e9b-524b-48f6-8b4d-d5be3f8d9077', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:28 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9876be-b677-4a14-be54-fd20bfa8a261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:28 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da9876be-b677-4a14-be54-fd20bfa8a261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:28 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd0369d-b75c-4717-a13f-61c29cde7287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:28 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Volume c2e58e9b-524b-48f6-8b4d-d5be3f8d9077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2e58e9b-524b-48f6-8b4d-d5be3f8d9077', 'volume_size': 1} Apr 16 22:59:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:29 devstack sudo[86051]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5ef32b85-2d70-4113-b52f-6a2b2c670483 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.9216f37b-7836-482a-a7ee-a5f7cc297f2d" returned: 0 in 0.965s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5ef32b85-2d70-4113-b52f-6a2b2c670483 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:29 devstack sudo[86076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.info Apr 16 22:59:29 devstack sudo[86076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:29 devstack sudo[86053]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-42f92a82-fdfc-4d17-b6a8-bdda005296e8 tempest-GroupSnapshotsTest-545220734 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666" returned: 0 in 1.074s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-42f92a82-fdfc-4d17-b6a8-bdda005296e8 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:29 devstack sudo[86083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666 Apr 16 22:59:29 devstack sudo[86083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:29 devstack sudo[86076]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5ef32b85-2d70-4113-b52f-6a2b2c670483 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.info" returned: 0 in 0.762s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:29 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-5ef32b85-2d70-4113-b52f-6a2b2c670483 tempest-VolumesSnapshotTestJSON-1853747142 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.info is being set with open permissions: ugo+rw Apr 16 22:59:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5ef32b85-2d70-4113-b52f-6a2b2c670483 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:29 devstack sudo[86107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.info Apr 16 22:59:29 devstack sudo[86107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:30 devstack sudo[86083]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-42f92a82-fdfc-4d17-b6a8-bdda005296e8 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666" returned: 0 in 0.646s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:30 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-42f92a82-fdfc-4d17-b6a8-bdda005296e8 tempest-GroupSnapshotsTest-545220734 None] Lock "cinder-quobyte-f6f8ac0f-6120-46a7-aa6d-13a6dc7a9666" released by "delete_volume" :: held 1.869s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:30 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-42f92a82-fdfc-4d17-b6a8-bdda005296e8 tempest-GroupSnapshotsTest-545220734 None] Created reservations ['73d1978f-2a19-4512-9283-8ea788f5e882'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:59:30 devstack cinder-volume[81971]: WARNING cinder.quota [None req-42f92a82-fdfc-4d17-b6a8-bdda005296e8 tempest-GroupSnapshotsTest-545220734 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1177747124 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1177747124, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:59:30 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-42f92a82-fdfc-4d17-b6a8-bdda005296e8 tempest-GroupSnapshotsTest-545220734 None] Created reservations ['25ee54be-4eb4-4078-94de-2645b034258a', '99f87001-f957-4cd8-a3d8-4836f61b4b3f', 'd9f9df1c-6bd9-4076-a122-dd89ccc89dfd', '611ae904-a99f-4bbc-9c3f-3cba3a94b1d6'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:59:30 devstack sudo[86107]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-42f92a82-fdfc-4d17-b6a8-bdda005296e8 tempest-GroupSnapshotsTest-545220734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-42f92a82-fdfc-4d17-b6a8-bdda005296e8 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:30 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-42f92a82-fdfc-4d17-b6a8-bdda005296e8 tempest-GroupSnapshotsTest-545220734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:59:30 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-42f92a82-fdfc-4d17-b6a8-bdda005296e8 tempest-GroupSnapshotsTest-545220734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:59:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-42f92a82-fdfc-4d17-b6a8-bdda005296e8 tempest-GroupSnapshotsTest-545220734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-42f92a82-fdfc-4d17-b6a8-bdda005296e8 tempest-GroupSnapshotsTest-545220734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5ef32b85-2d70-4113-b52f-6a2b2c670483 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.info" returned: 0 in 0.804s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5ef32b85-2d70-4113-b52f-6a2b2c670483 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.567s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.128s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:30 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-323007667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e58e9b-524b-48f6-8b4d-d5be3f8d9077,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0517ee8ba5a14e33ad487efa6fd9b492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:59:28Z,use_quota=True,user_id='12f0f8ebed774353816e2eb992d89e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:59:30 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Creating volume c2e58e9b-524b-48f6-8b4d-d5be3f8d9077 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:59:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:30 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:59:30 devstack sudo[86113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:59:30 devstack sudo[86113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:30 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:59:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:30 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:59:30 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:59:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c2e58e9b-524b-48f6-8b4d-d5be3f8d9077 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:30 devstack sudo[86115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c2e58e9b-524b-48f6-8b4d-d5be3f8d9077 1073741824 Apr 16 22:59:30 devstack sudo[86115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:30 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-5ef32b85-2d70-4113-b52f-6a2b2c670483 tempest-VolumesSnapshotTestJSON-1853747142 None] Create snapshot completed successfully Apr 16 22:59:31 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-62f10cee-1817-4a6b-9917-e632143442d2 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "cinder-9216f37b-7836-482a-a7ee-a5f7cc297f2d-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:31 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-62f10cee-1817-4a6b-9917-e632143442d2 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-9216f37b-7836-482a-a7ee-a5f7cc297f2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:31 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-62f10cee-1817-4a6b-9917-e632143442d2 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "cinder-quobyte-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:31 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-62f10cee-1817-4a6b-9917-e632143442d2 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:31 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-62f10cee-1817-4a6b-9917-e632143442d2 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "cinder-quobyte-9216f37b-7836-482a-a7ee-a5f7cc297f2d" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:31 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-62f10cee-1817-4a6b-9917-e632143442d2 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-9216f37b-7836-482a-a7ee-a5f7cc297f2d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:31 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-62f10cee-1817-4a6b-9917-e632143442d2 tempest-VolumesSnapshotTestJSON-1853747142 None] Deleting offline snapshot 9216f37b-7836-482a-a7ee-a5f7cc297f2d of volume f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:59:31 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-62f10cee-1817-4a6b-9917-e632143442d2 tempest-VolumesSnapshotTestJSON-1853747142 None] snapshot_file for this snap is: volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.9216f37b-7836-482a-a7ee-a5f7cc297f2d {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:59:31 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefd8a1d-1476-4cb6-a272-789eb7818041]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-62f10cee-1817-4a6b-9917-e632143442d2 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.9216f37b-7836-482a-a7ee-a5f7cc297f2d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:32 devstack sudo[86113]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-42f92a82-fdfc-4d17-b6a8-bdda005296e8 tempest-GroupSnapshotsTest-545220734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 1.403s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:32 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-42f92a82-fdfc-4d17-b6a8-bdda005296e8 tempest-GroupSnapshotsTest-545220734 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:59:32 devstack sudo[86121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.9216f37b-7836-482a-a7ee-a5f7cc297f2d Apr 16 22:59:32 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-42f92a82-fdfc-4d17-b6a8-bdda005296e8 tempest-GroupSnapshotsTest-545220734 None] Delete group completed successfully. Apr 16 22:59:32 devstack sudo[86121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:32 devstack sudo[86115]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c2e58e9b-524b-48f6-8b4d-d5be3f8d9077 1073741824" returned: 0 in 1.953s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c2e58e9b-524b-48f6-8b4d-d5be3f8d9077 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:32 devstack sudo[86128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c2e58e9b-524b-48f6-8b4d-d5be3f8d9077 Apr 16 22:59:32 devstack sudo[86128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:33 devstack sudo[86121]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-62f10cee-1817-4a6b-9917-e632143442d2 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.9216f37b-7836-482a-a7ee-a5f7cc297f2d" returned: 0 in 1.776s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-62f10cee-1817-4a6b-9917-e632143442d2 tempest-VolumesSnapshotTestJSON-1853747142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:59:33 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f50ef1-8482-466d-9642-e33f41ac79ea]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-62f10cee-1817-4a6b-9917-e632143442d2 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:33 devstack sudo[86136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8 Apr 16 22:59:33 devstack sudo[86136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:34 devstack sudo[86128]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c2e58e9b-524b-48f6-8b4d-d5be3f8d9077" returned: 0 in 1.370s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:34 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] <== create_volume: return (3405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:59:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.414s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd0369d-b75c-4717-a13f-61c29cde7287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2e58e9b-524b-48f6-8b4d-d5be3f8d9077', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c97a3f-5afa-4726-bfee-9f725762cd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:34 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Volume volume-c2e58e9b-524b-48f6-8b4d-d5be3f8d9077 (c2e58e9b-524b-48f6-8b4d-d5be3f8d9077): created successfully Apr 16 22:59:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c97a3f-5afa-4726-bfee-9f725762cd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Flow 'volume_create_manager' (366553fc-7416-4891-b39b-56be880e43f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:59:34 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-6f44978c-7efc-494f-98b1-d096bae3d4bd tempest-VolumesListTestJSON-314958204 None] Created volume successfully. Apr 16 22:59:34 devstack sudo[86136]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-62f10cee-1817-4a6b-9917-e632143442d2 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8" returned: 0 in 1.002s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-62f10cee-1817-4a6b-9917-e632143442d2 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.9216f37b-7836-482a-a7ee-a5f7cc297f2d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:34 devstack sudo[86164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.9216f37b-7836-482a-a7ee-a5f7cc297f2d Apr 16 22:59:34 devstack sudo[86164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:34 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:59:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Flow 'volume_create_manager' (3711c515-ad9c-4f8c-9d95-8489215e1b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:59:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e941922-f1b9-49d0-afe2-309601ce395d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e941922-f1b9-49d0-afe2-309601ce395d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-537828805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78a50fa-59fc-455e-bffa-a5fce33063f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0517ee8ba5a14e33ad487efa6fd9b492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:59:35Z,use_quota=True,user_id='12f0f8ebed774353816e2eb992d89e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f665dc1-b190-4a24-9a32-3e8ccfa274a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f665dc1-b190-4a24-9a32-3e8ccfa274a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a1fd17-0ea5-4edc-8840-b37a68a8bb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a1fd17-0ea5-4edc-8840-b37a68a8bb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd78a50fa-59fc-455e-bffa-a5fce33063f2', 'volume_name': 'volume-d78a50fa-59fc-455e-bffa-a5fce33063f2', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d256965-71e8-4841-a5a3-42a6c1edbf7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d256965-71e8-4841-a5a3-42a6c1edbf7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baac3542-6ade-4c97-af9c-88cf30485e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:35 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Volume d78a50fa-59fc-455e-bffa-a5fce33063f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d78a50fa-59fc-455e-bffa-a5fce33063f2', 'volume_size': 1} Apr 16 22:59:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-537828805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d78a50fa-59fc-455e-bffa-a5fce33063f2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0517ee8ba5a14e33ad487efa6fd9b492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:59:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:59:35Z,use_quota=True,user_id='12f0f8ebed774353816e2eb992d89e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:59:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Creating volume d78a50fa-59fc-455e-bffa-a5fce33063f2 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:59:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:59:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:59:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:59:35 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:59:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d78a50fa-59fc-455e-bffa-a5fce33063f2 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:35 devstack sudo[86166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d78a50fa-59fc-455e-bffa-a5fce33063f2 1073741824 Apr 16 22:59:35 devstack sudo[86166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:35 devstack sudo[86164]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-62f10cee-1817-4a6b-9917-e632143442d2 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.9216f37b-7836-482a-a7ee-a5f7cc297f2d" returned: 0 in 0.950s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-62f10cee-1817-4a6b-9917-e632143442d2 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.9216f37b-7836-482a-a7ee-a5f7cc297f2d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:35 devstack sudo[86177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.9216f37b-7836-482a-a7ee-a5f7cc297f2d Apr 16 22:59:35 devstack sudo[86177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:36 devstack sudo[86166]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d78a50fa-59fc-455e-bffa-a5fce33063f2 1073741824" returned: 0 in 1.049s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d78a50fa-59fc-455e-bffa-a5fce33063f2 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:36 devstack sudo[86180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d78a50fa-59fc-455e-bffa-a5fce33063f2 Apr 16 22:59:36 devstack sudo[86180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:36 devstack sudo[86177]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-62f10cee-1817-4a6b-9917-e632143442d2 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8.9216f37b-7836-482a-a7ee-a5f7cc297f2d" returned: 0 in 0.726s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:36 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-62f10cee-1817-4a6b-9917-e632143442d2 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-9216f37b-7836-482a-a7ee-a5f7cc297f2d" released by "_delete_snapshot" :: held 4.585s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:36 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-62f10cee-1817-4a6b-9917-e632143442d2 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8" released by "delete_snapshot" :: held 4.619s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:36 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-62f10cee-1817-4a6b-9917-e632143442d2 tempest-VolumesSnapshotTestJSON-1853747142 None] Created reservations ['29970d3c-49c1-44c5-bf4b-4c46cecd2242', '03b7f73e-e530-4606-91e1-eea5fadc7d24', '573e8fcb-f0dc-4b03-a6db-2b28577d30a8', 'be061289-d039-4360-9828-b03733face49'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:59:36 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-62f10cee-1817-4a6b-9917-e632143442d2 tempest-VolumesSnapshotTestJSON-1853747142 None] Delete snapshot completed successfully. Apr 16 22:59:36 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-62f10cee-1817-4a6b-9917-e632143442d2 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-9216f37b-7836-482a-a7ee-a5f7cc297f2d-delete_snapshot" released by "delete_snapshot" :: held 4.814s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:36 devstack sudo[86180]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d78a50fa-59fc-455e-bffa-a5fce33063f2" returned: 0 in 0.743s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:59:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.845s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baac3542-6ade-4c97-af9c-88cf30485e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d78a50fa-59fc-455e-bffa-a5fce33063f2', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e4ad84-343e-45c0-9b4c-0ec708662855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:36 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Volume volume-d78a50fa-59fc-455e-bffa-a5fce33063f2 (d78a50fa-59fc-455e-bffa-a5fce33063f2): created successfully Apr 16 22:59:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e4ad84-343e-45c0-9b4c-0ec708662855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Flow 'volume_create_manager' (3711c515-ad9c-4f8c-9d95-8489215e1b62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:59:36 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-5d081db7-4a6c-48d4-9208-4364e07f2960 tempest-VolumesListTestJSON-314958204 None] Created volume successfully. Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Flow 'volume_create_manager' (0b205333-96e0-4ee5-a887-0c27446aad1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d078723c-bdf0-405c-a764-355c8959aaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d078723c-bdf0-405c-a764-355c8959aaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-953641918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69769a80-2b3c-4143-b85a-5cb5b88f6779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95769188ca74a1086bac8f54eb7ca25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:59:38Z,use_quota=True,user_id='25a8c52cd1de40919e7c2f6c19b827e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93937033-3e9b-4e8c-b43c-ccc64f12d880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93937033-3e9b-4e8c-b43c-ccc64f12d880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca751cab-3336-4c72-8d87-33e6eaf77214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca751cab-3336-4c72-8d87-33e6eaf77214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69769a80-2b3c-4143-b85a-5cb5b88f6779', 'volume_name': 'volume-69769a80-2b3c-4143-b85a-5cb5b88f6779', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96dc9567-27f3-43dd-b3be-e4ee81c7a642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96dc9567-27f3-43dd-b3be-e4ee81c7a642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52d926c-69e1-4fa8-882c-9668ad3e076b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:37 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Volume 69769a80-2b3c-4143-b85a-5cb5b88f6779: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69769a80-2b3c-4143-b85a-5cb5b88f6779', 'volume_size': 1} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-953641918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69769a80-2b3c-4143-b85a-5cb5b88f6779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95769188ca74a1086bac8f54eb7ca25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:59:38Z,use_quota=True,user_id='25a8c52cd1de40919e7c2f6c19b827e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Creating volume 69769a80-2b3c-4143-b85a-5cb5b88f6779 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:59:37 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:37 devstack sudo[86186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779 1073741824 Apr 16 22:59:37 devstack sudo[86186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Flow 'volume_create_manager' (4d33ef97-4f85-4cf2-8ffe-81a4044f3200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c5d351-049a-4e52-b114-3207d013389c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c5d351-049a-4e52-b114-3207d013389c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-276166090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df8e510c-6d82-4708-b91f-aaabf1304a8e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0517ee8ba5a14e33ad487efa6fd9b492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:59:38Z,use_quota=True,user_id='12f0f8ebed774353816e2eb992d89e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed6d4451-1d34-4060-920a-f30bd485bde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed6d4451-1d34-4060-920a-f30bd485bde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93268b75-db61-4118-9bd4-c04d02b43e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93268b75-db61-4118-9bd4-c04d02b43e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df8e510c-6d82-4708-b91f-aaabf1304a8e', 'volume_name': 'volume-df8e510c-6d82-4708-b91f-aaabf1304a8e', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d919bfb-213f-4005-8cb1-78d0fa06de05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d919bfb-213f-4005-8cb1-78d0fa06de05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a5b223-f026-45be-ab4a-dd1a9ff3c8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:37 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Volume df8e510c-6d82-4708-b91f-aaabf1304a8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df8e510c-6d82-4708-b91f-aaabf1304a8e', 'volume_size': 1} Apr 16 22:59:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:37 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-5f2cf296-371d-4db4-b1ae-fd01fca510aa tempest-GroupSnapshotsV319Test-574987265 None] Group tempest-GroupSnapshotsV319Test-Group-2042531179: creating Apr 16 22:59:37 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-5f2cf296-371d-4db4-b1ae-fd01fca510aa tempest-GroupSnapshotsV319Test-574987265 None] Group tempest-GroupSnapshotsV319Test-Group-2042531179: created successfully Apr 16 22:59:38 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-5f2cf296-371d-4db4-b1ae-fd01fca510aa tempest-GroupSnapshotsV319Test-574987265 None] Create group completed successfully. Apr 16 22:59:38 devstack cinder-volume[81971]: INFO cinder.volume.manager [req-d68dbddf-7645-4021-9b7b-546b3ab5e799 req-7f94ea8c-7f71-4ea0-be39-d16d8ac012a2 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Terminate volume connection completed successfully. Apr 16 22:59:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-d68dbddf-7645-4021-9b7b-546b3ab5e799 req-7f94ea8c-7f71-4ea0-be39-d16d8ac012a2 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Deleting attachment 820cb632-370f-4822-832a-aac5afcd8c04. {{(pid=81971) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 16 22:59:38 devstack sudo[86186]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779 1073741824" returned: 0 in 0.674s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:38 devstack sudo[86192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779 Apr 16 22:59:38 devstack sudo[86192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:38 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-d68dbddf-7645-4021-9b7b-546b3ab5e799 req-7ca11977-c328-4a2e-8776-7382e567bdc8 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Acquiring lock "cinder-45cf112e-9ac7-4cf3-8e02-75aabdac3202-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:38 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-d68dbddf-7645-4021-9b7b-546b3ab5e799 req-7ca11977-c328-4a2e-8776-7382e567bdc8 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Lock "cinder-45cf112e-9ac7-4cf3-8e02-75aabdac3202-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:38 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-d68dbddf-7645-4021-9b7b-546b3ab5e799 req-7ca11977-c328-4a2e-8776-7382e567bdc8 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Acquiring lock "cinder-quobyte-45cf112e-9ac7-4cf3-8e02-75aabdac3202" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:38 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-d68dbddf-7645-4021-9b7b-546b3ab5e799 req-7ca11977-c328-4a2e-8776-7382e567bdc8 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Lock "cinder-quobyte-45cf112e-9ac7-4cf3-8e02-75aabdac3202" acquired by "delete_volume" :: waited 0.014s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:38 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cca0d14-2c3e-4aeb-b446-57cc4b31c0d2]: (4, 'raw') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-d68dbddf-7645-4021-9b7b-546b3ab5e799 req-7ca11977-c328-4a2e-8776-7382e567bdc8 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:39 devstack sudo[86192]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779" returned: 0 in 0.534s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.074s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-276166090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df8e510c-6d82-4708-b91f-aaabf1304a8e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0517ee8ba5a14e33ad487efa6fd9b492',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:59:38Z,use_quota=True,user_id='12f0f8ebed774353816e2eb992d89e91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Creating volume df8e510c-6d82-4708-b91f-aaabf1304a8e {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:59:39 devstack sudo[86195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 Apr 16 22:59:39 devstack sudo[86195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:59:39 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-df8e510c-6d82-4708-b91f-aaabf1304a8e 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:39 devstack sudo[86197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-df8e510c-6d82-4708-b91f-aaabf1304a8e 1073741824 Apr 16 22:59:39 devstack sudo[86197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e52d926c-69e1-4fa8-882c-9668ad3e076b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69769a80-2b3c-4143-b85a-5cb5b88f6779', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c35c5e-b151-4fae-b523-8a72c7944a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:39 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Volume volume-69769a80-2b3c-4143-b85a-5cb5b88f6779 (69769a80-2b3c-4143-b85a-5cb5b88f6779): created successfully Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c35c5e-b151-4fae-b523-8a72c7944a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Flow 'volume_create_manager' (0b205333-96e0-4ee5-a887-0c27446aad1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:59:39 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-38380e1c-9095-4ed7-8f2e-36558d8f7ec6 tempest-VolumesSnapshotTestJSON-1853747142 None] Created volume successfully. Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Flow 'volume_create_manager' (4cbc567a-0913-4869-b672-60916c1f2b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d6191a7-6138-44ba-99aa-665b1259262a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d6191a7-6138-44ba-99aa-665b1259262a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-994395573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5bf3178c-db03-4d4b-8b95-0875cdafedcf,host='devstack@QuobyteHD#QuobyteHD',id=7493da1f-4c23-4c8f-9254-cf59f100c0d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254247a89afe48ffbb99815471d5c1b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:59:39Z,use_quota=True,user_id='394eed4e7f1443e188af95b2e620dd1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c8e4df1-19b0-4c44-a34c-8e4065c630ef),volume_type_id=3c8e4df1-19b0-4c44-a34c-8e4065c630ef)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4b7cde-075c-437f-b3a5-7e7cd0d74d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4b7cde-075c-437f-b3a5-7e7cd0d74d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83dfe5b9-7fb4-417d-968a-2b33ed11b893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83dfe5b9-7fb4-417d-968a-2b33ed11b893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7493da1f-4c23-4c8f-9254-cf59f100c0d9', 'volume_name': 'volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6f5735-a2c6-413e-86dd-36b1be9b2c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf6f5735-a2c6-413e-86dd-36b1be9b2c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66bf681b-ec00-41ca-a80d-656b4b16d7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:39 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Volume 7493da1f-4c23-4c8f-9254-cf59f100c0d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9', 'volume_size': 1} Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:39 devstack sudo[86197]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-df8e510c-6d82-4708-b91f-aaabf1304a8e 1073741824" returned: 0 in 0.711s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:39 devstack sudo[86195]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-d68dbddf-7645-4021-9b7b-546b3ab5e799 req-7ca11977-c328-4a2e-8776-7382e567bdc8 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202" returned: 0 in 0.856s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-d68dbddf-7645-4021-9b7b-546b3ab5e799 req-7ca11977-c328-4a2e-8776-7382e567bdc8 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-df8e510c-6d82-4708-b91f-aaabf1304a8e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:39 devstack sudo[86205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-df8e510c-6d82-4708-b91f-aaabf1304a8e Apr 16 22:59:39 devstack sudo[86205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:39 devstack sudo[86204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 Apr 16 22:59:39 devstack sudo[86204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a9721a19-d771-4750-9ee3-92c424f9f98b tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:40 devstack sudo[86205]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-df8e510c-6d82-4708-b91f-aaabf1304a8e" returned: 0 in 0.528s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:59:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.875s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5bf3178c-db03-4d4b-8b95-0875cdafedcf,created_at=2026-04-16T20:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-994395573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5bf3178c-db03-4d4b-8b95-0875cdafedcf,host='devstack@QuobyteHD#QuobyteHD',id=7493da1f-4c23-4c8f-9254-cf59f100c0d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='254247a89afe48ffbb99815471d5c1b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:59:39Z,use_quota=True,user_id='394eed4e7f1443e188af95b2e620dd1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3c8e4df1-19b0-4c44-a34c-8e4065c630ef),volume_type_id=3c8e4df1-19b0-4c44-a34c-8e4065c630ef)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:59:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Creating volume 7493da1f-4c23-4c8f-9254-cf59f100c0d9 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:59:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:59:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:59:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:59:40 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:59:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:40 devstack sudo[86209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9 1073741824 Apr 16 22:59:40 devstack sudo[86209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:40 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a5b223-f026-45be-ab4a-dd1a9ff3c8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df8e510c-6d82-4708-b91f-aaabf1304a8e', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:40 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a648f53e-fe8a-4b86-8baf-94cd4ca46ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:40 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Volume volume-df8e510c-6d82-4708-b91f-aaabf1304a8e (df8e510c-6d82-4708-b91f-aaabf1304a8e): created successfully Apr 16 22:59:40 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a648f53e-fe8a-4b86-8baf-94cd4ca46ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:40 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Flow 'volume_create_manager' (4d33ef97-4f85-4cf2-8ffe-81a4044f3200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:59:40 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-60991b6d-5de7-481d-8bff-32c97e8b6ac5 tempest-VolumesListTestJSON-314958204 None] Created volume successfully. Apr 16 22:59:40 devstack sudo[86204]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-d68dbddf-7645-4021-9b7b-546b3ab5e799 req-7ca11977-c328-4a2e-8776-7382e567bdc8 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202" returned: 1 in 0.737s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-d68dbddf-7645-4021-9b7b-546b3ab5e799 req-7ca11977-c328-4a2e-8776-7382e567bdc8 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202' failed. Not Retrying. {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 22:59:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-d68dbddf-7645-4021-9b7b-546b3ab5e799 req-7ca11977-c328-4a2e-8776-7382e567bdc8 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:40 devstack sudo[86214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202 Apr 16 22:59:40 devstack sudo[86214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:40 devstack sudo[86209]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9 1073741824" returned: 0 in 0.598s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:41 devstack sudo[86220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9 Apr 16 22:59:41 devstack sudo[86220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:41 devstack sudo[86214]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-d68dbddf-7645-4021-9b7b-546b3ab5e799 req-7ca11977-c328-4a2e-8776-7382e567bdc8 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-45cf112e-9ac7-4cf3-8e02-75aabdac3202" returned: 0 in 0.612s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:41 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-d68dbddf-7645-4021-9b7b-546b3ab5e799 req-7ca11977-c328-4a2e-8776-7382e567bdc8 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Lock "cinder-quobyte-45cf112e-9ac7-4cf3-8e02-75aabdac3202" released by "delete_volume" :: held 2.268s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:41 devstack cinder-volume[81971]: DEBUG cinder.quota [req-d68dbddf-7645-4021-9b7b-546b3ab5e799 req-7ca11977-c328-4a2e-8776-7382e567bdc8 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Created reservations ['b5b67bab-08ea-4d57-9490-83268d157711', '3b982053-4d79-4a3b-a313-8b199d0f069b', '606fadca-d74a-4970-9f2c-20873e7cee46', '9c4965b0-b3c4-4dc6-83b0-0371371c2a2d'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:59:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-d68dbddf-7645-4021-9b7b-546b3ab5e799 req-7ca11977-c328-4a2e-8776-7382e567bdc8 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-d68dbddf-7645-4021-9b7b-546b3ab5e799 req-7ca11977-c328-4a2e-8776-7382e567bdc8 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:41 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-d68dbddf-7645-4021-9b7b-546b3ab5e799 req-7ca11977-c328-4a2e-8776-7382e567bdc8 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:59:41 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-d68dbddf-7645-4021-9b7b-546b3ab5e799 req-7ca11977-c328-4a2e-8776-7382e567bdc8 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:59:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-d68dbddf-7645-4021-9b7b-546b3ab5e799 req-7ca11977-c328-4a2e-8776-7382e567bdc8 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-d68dbddf-7645-4021-9b7b-546b3ab5e799 req-7ca11977-c328-4a2e-8776-7382e567bdc8 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:41 devstack sudo[86222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:59:41 devstack sudo[86222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:41 devstack sudo[86220]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9" returned: 0 in 0.627s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:41 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:59:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a9721a19-d771-4750-9ee3-92c424f9f98b tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.641s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:41 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66bf681b-ec00-41ca-a80d-656b4b16d7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:41 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2336831-213d-423e-b345-f3ef5e346e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:41 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-a9721a19-d771-4750-9ee3-92c424f9f98b tempest-VolumesSnapshotTestJSON-1853747142 None] Creating offline snapshot 5dfd6463-65de-4284-b12f-3acf05929f83 of volume 69769a80-2b3c-4143-b85a-5cb5b88f6779 {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:59:41 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Volume volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9 (7493da1f-4c23-4c8f-9254-cf59f100c0d9): created successfully Apr 16 22:59:41 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2336831-213d-423e-b345-f3ef5e346e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:41 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Flow 'volume_create_manager' (4cbc567a-0913-4869-b672-60916c1f2b3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:59:41 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcdc278-0777-4848-8c27-a4f0b12019b1]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a9721a19-d771-4750-9ee3-92c424f9f98b tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:41 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-bed087f4-b6e8-4789-ba94-dd45a6786a02 tempest-GroupSnapshotsV319Test-574987265 None] Created volume successfully. Apr 16 22:59:41 devstack sudo[86226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779 Apr 16 22:59:41 devstack sudo[86226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:41 devstack sudo[86222]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-d68dbddf-7645-4021-9b7b-546b3ab5e799 req-7ca11977-c328-4a2e-8776-7382e567bdc8 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.647s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:41 devstack cinder-volume[81971]: DEBUG cinder.manager [req-d68dbddf-7645-4021-9b7b-546b3ab5e799 req-7ca11977-c328-4a2e-8776-7382e567bdc8 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:59:41 devstack cinder-volume[81971]: INFO cinder.volume.manager [req-d68dbddf-7645-4021-9b7b-546b3ab5e799 req-7ca11977-c328-4a2e-8776-7382e567bdc8 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Deleted volume successfully. Apr 16 22:59:41 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-d68dbddf-7645-4021-9b7b-546b3ab5e799 req-7ca11977-c328-4a2e-8776-7382e567bdc8 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Lock "cinder-45cf112e-9ac7-4cf3-8e02-75aabdac3202-delete_volume" released by "delete_volume" :: held 3.106s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:42 devstack sudo[86226]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a9721a19-d771-4750-9ee3-92c424f9f98b tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779" returned: 0 in 0.649s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a9721a19-d771-4750-9ee3-92c424f9f98b tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.5dfd6463-65de-4284-b12f-3acf05929f83 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:42 devstack sudo[86233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.5dfd6463-65de-4284-b12f-3acf05929f83 1G Apr 16 22:59:42 devstack sudo[86233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:43 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-2fa39682-e1fa-4746-9cb9-10c78d738777 tempest-GroupSnapshotsV319Test-574987265 None] GroupSnapshot cb22f5a5-e9e7-4020-a221-e3d878e4ca77: creating. Apr 16 22:59:43 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2fa39682-e1fa-4746-9cb9-10c78d738777 tempest-GroupSnapshotsV319Test-574987265 None] Group snapshot cb22f5a5-e9e7-4020-a221-e3d878e4ca77: creating. {{(pid=81971) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 16 22:59:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2fa39682-e1fa-4746-9cb9-10c78d738777 tempest-GroupSnapshotsV319Test-574987265 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:43 devstack sudo[86233]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a9721a19-d771-4750-9ee3-92c424f9f98b tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.5dfd6463-65de-4284-b12f-3acf05929f83 1G" returned: 0 in 0.784s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a9721a19-d771-4750-9ee3-92c424f9f98b tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69769a80-2b3c-4143-b85a-5cb5b88f6779 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.5dfd6463-65de-4284-b12f-3acf05929f83 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:43 devstack sudo[86263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69769a80-2b3c-4143-b85a-5cb5b88f6779 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.5dfd6463-65de-4284-b12f-3acf05929f83 Apr 16 22:59:43 devstack sudo[86263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:43 devstack sudo[86263]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a9721a19-d771-4750-9ee3-92c424f9f98b tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-69769a80-2b3c-4143-b85a-5cb5b88f6779 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.5dfd6463-65de-4284-b12f-3acf05929f83" returned: 0 in 0.555s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:43 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-a9721a19-d771-4750-9ee3-92c424f9f98b tempest-VolumesSnapshotTestJSON-1853747142 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.5dfd6463-65de-4284-b12f-3acf05929f83 is being set with open permissions: ugo+rw Apr 16 22:59:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a9721a19-d771-4750-9ee3-92c424f9f98b tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.5dfd6463-65de-4284-b12f-3acf05929f83 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:43 devstack sudo[86269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.5dfd6463-65de-4284-b12f-3acf05929f83 Apr 16 22:59:43 devstack sudo[86269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7bc4dd0e-67d2-4667-9cf9-95ea5714a0a7 tempest-VolumesListTestJSON-314958204 None] Acquiring lock "cinder-df8e510c-6d82-4708-b91f-aaabf1304a8e-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7bc4dd0e-67d2-4667-9cf9-95ea5714a0a7 tempest-VolumesListTestJSON-314958204 None] Lock "cinder-df8e510c-6d82-4708-b91f-aaabf1304a8e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7bc4dd0e-67d2-4667-9cf9-95ea5714a0a7 tempest-VolumesListTestJSON-314958204 None] Acquiring lock "cinder-quobyte-df8e510c-6d82-4708-b91f-aaabf1304a8e" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7bc4dd0e-67d2-4667-9cf9-95ea5714a0a7 tempest-VolumesListTestJSON-314958204 None] Lock "cinder-quobyte-df8e510c-6d82-4708-b91f-aaabf1304a8e" acquired by "delete_volume" :: waited 0.009s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:43 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e81dd2d-b430-407e-adce-ff1e43afa996]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7bc4dd0e-67d2-4667-9cf9-95ea5714a0a7 tempest-VolumesListTestJSON-314958204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-df8e510c-6d82-4708-b91f-aaabf1304a8e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:44 devstack sudo[86271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-df8e510c-6d82-4708-b91f-aaabf1304a8e Apr 16 22:59:44 devstack sudo[86271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:44 devstack sudo[86269]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a9721a19-d771-4750-9ee3-92c424f9f98b tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.5dfd6463-65de-4284-b12f-3acf05929f83" returned: 0 in 0.505s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a9721a19-d771-4750-9ee3-92c424f9f98b tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:44 devstack sudo[86275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.info Apr 16 22:59:44 devstack sudo[86275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:44 devstack sudo[86271]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7bc4dd0e-67d2-4667-9cf9-95ea5714a0a7 tempest-VolumesListTestJSON-314958204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-df8e510c-6d82-4708-b91f-aaabf1304a8e" returned: 0 in 0.680s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7bc4dd0e-67d2-4667-9cf9-95ea5714a0a7 tempest-VolumesListTestJSON-314958204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-df8e510c-6d82-4708-b91f-aaabf1304a8e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:44 devstack sudo[86283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-df8e510c-6d82-4708-b91f-aaabf1304a8e Apr 16 22:59:44 devstack sudo[86283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:44 devstack sudo[86275]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a9721a19-d771-4750-9ee3-92c424f9f98b tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.info" returned: 0 in 0.521s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:44 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-a9721a19-d771-4750-9ee3-92c424f9f98b tempest-VolumesSnapshotTestJSON-1853747142 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.info is being set with open permissions: ugo+rw Apr 16 22:59:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a9721a19-d771-4750-9ee3-92c424f9f98b tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:44 devstack sudo[86285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.info Apr 16 22:59:44 devstack sudo[86285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:45 devstack sudo[86283]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7bc4dd0e-67d2-4667-9cf9-95ea5714a0a7 tempest-VolumesListTestJSON-314958204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-df8e510c-6d82-4708-b91f-aaabf1304a8e" returned: 0 in 0.458s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7bc4dd0e-67d2-4667-9cf9-95ea5714a0a7 tempest-VolumesListTestJSON-314958204 None] Lock "cinder-quobyte-df8e510c-6d82-4708-b91f-aaabf1304a8e" released by "delete_volume" :: held 1.177s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:45 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-7bc4dd0e-67d2-4667-9cf9-95ea5714a0a7 tempest-VolumesListTestJSON-314958204 None] Created reservations ['efdfbbec-c195-4d9e-9d87-4ca4563d222a', 'd01c2d7a-2933-432b-92bf-7f2ae078b3f2', '58f4e705-6a3a-45e7-aead-00804e214ddc', 'b399e0e7-f22e-4e22-976b-10d2755b050e'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:59:45 devstack sudo[86285]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a9721a19-d771-4750-9ee3-92c424f9f98b tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.info" returned: 0 in 0.482s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a9721a19-d771-4750-9ee3-92c424f9f98b tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.605s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2fa39682-e1fa-4746-9cb9-10c78d738777 tempest-GroupSnapshotsV319Test-574987265 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.146s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:45 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-2fa39682-e1fa-4746-9cb9-10c78d738777 tempest-GroupSnapshotsV319Test-574987265 None] Creating offline snapshot 0992aaa6-b2b9-411d-a17a-a99984f34fa7 of volume 7493da1f-4c23-4c8f-9254-cf59f100c0d9 {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 22:59:45 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-a9721a19-d771-4750-9ee3-92c424f9f98b tempest-VolumesSnapshotTestJSON-1853747142 None] Create snapshot completed successfully Apr 16 22:59:45 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec131922-3526-47c4-87dc-dac2c0227c76]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2fa39682-e1fa-4746-9cb9-10c78d738777 tempest-GroupSnapshotsV319Test-574987265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-7bc4dd0e-67d2-4667-9cf9-95ea5714a0a7 tempest-VolumesListTestJSON-314958204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-7bc4dd0e-67d2-4667-9cf9-95ea5714a0a7 tempest-VolumesListTestJSON-314958204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:45 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-7bc4dd0e-67d2-4667-9cf9-95ea5714a0a7 tempest-VolumesListTestJSON-314958204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:59:45 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-7bc4dd0e-67d2-4667-9cf9-95ea5714a0a7 tempest-VolumesListTestJSON-314958204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:59:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-7bc4dd0e-67d2-4667-9cf9-95ea5714a0a7 tempest-VolumesListTestJSON-314958204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7bc4dd0e-67d2-4667-9cf9-95ea5714a0a7 tempest-VolumesListTestJSON-314958204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:45 devstack sudo[86291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:59:45 devstack sudo[86291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:45 devstack sudo[86290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9 Apr 16 22:59:45 devstack sudo[86290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:45 devstack sudo[86291]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7bc4dd0e-67d2-4667-9cf9-95ea5714a0a7 tempest-VolumesListTestJSON-314958204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.468s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:45 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-7bc4dd0e-67d2-4667-9cf9-95ea5714a0a7 tempest-VolumesListTestJSON-314958204 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:59:45 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-7bc4dd0e-67d2-4667-9cf9-95ea5714a0a7 tempest-VolumesListTestJSON-314958204 None] Deleted volume successfully. Apr 16 22:59:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7bc4dd0e-67d2-4667-9cf9-95ea5714a0a7 tempest-VolumesListTestJSON-314958204 None] Lock "cinder-df8e510c-6d82-4708-b91f-aaabf1304a8e-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:45 devstack sudo[86290]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2fa39682-e1fa-4746-9cb9-10c78d738777 tempest-GroupSnapshotsV319Test-574987265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9" returned: 0 in 0.536s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2fa39682-e1fa-4746-9cb9-10c78d738777 tempest-GroupSnapshotsV319Test-574987265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.0992aaa6-b2b9-411d-a17a-a99984f34fa7 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:45 devstack sudo[86298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.0992aaa6-b2b9-411d-a17a-a99984f34fa7 1G Apr 16 22:59:45 devstack sudo[86298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8a03e467-e689-44f3-b681-44928a109735 tempest-VolumesListTestJSON-314958204 None] Acquiring lock "cinder-d78a50fa-59fc-455e-bffa-a5fce33063f2-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8a03e467-e689-44f3-b681-44928a109735 tempest-VolumesListTestJSON-314958204 None] Lock "cinder-d78a50fa-59fc-455e-bffa-a5fce33063f2-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8a03e467-e689-44f3-b681-44928a109735 tempest-VolumesListTestJSON-314958204 None] Acquiring lock "cinder-quobyte-d78a50fa-59fc-455e-bffa-a5fce33063f2" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8a03e467-e689-44f3-b681-44928a109735 tempest-VolumesListTestJSON-314958204 None] Lock "cinder-quobyte-d78a50fa-59fc-455e-bffa-a5fce33063f2" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:46 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[38944ae3-248a-44eb-9f39-4a2d231a1669]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8a03e467-e689-44f3-b681-44928a109735 tempest-VolumesListTestJSON-314958204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d78a50fa-59fc-455e-bffa-a5fce33063f2 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:46 devstack sudo[86303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d78a50fa-59fc-455e-bffa-a5fce33063f2 Apr 16 22:59:46 devstack sudo[86303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:46 devstack sudo[86298]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2fa39682-e1fa-4746-9cb9-10c78d738777 tempest-GroupSnapshotsV319Test-574987265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.0992aaa6-b2b9-411d-a17a-a99984f34fa7 1G" returned: 0 in 0.594s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2fa39682-e1fa-4746-9cb9-10c78d738777 tempest-GroupSnapshotsV319Test-574987265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.0992aaa6-b2b9-411d-a17a-a99984f34fa7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:46 devstack sudo[86311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.0992aaa6-b2b9-411d-a17a-a99984f34fa7 Apr 16 22:59:46 devstack sudo[86311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:46 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:59:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Flow 'volume_create_manager' (f0c3eebf-92d1-438a-a55c-921f8911ee6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:59:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b0aadd-4a8f-450f-b9c2-276d83718f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76b0aadd-4a8f-450f-b9c2-276d83718f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1022353578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc060a3-3b1e-4a86-943a-fbc3606eb0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95769188ca74a1086bac8f54eb7ca25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:59:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=5dfd6463-65de-4284-b12f-3acf05929f83,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:59:47Z,use_quota=True,user_id='25a8c52cd1de40919e7c2f6c19b827e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29eeb789-433b-4ecf-9ff3-ee34b57b00af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29eeb789-433b-4ecf-9ff3-ee34b57b00af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dde4745-5116-4d50-9716-6a01f54567ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dde4745-5116-4d50-9716-6a01f54567ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1fc060a3-3b1e-4a86-943a-fbc3606eb0b2', 'volume_name': 'volume-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2', 'volume_size': 2, 'snapshot_id': '5dfd6463-65de-4284-b12f-3acf05929f83'}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2379aab3-eb74-4d15-9a61-54084d539797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2379aab3-eb74-4d15-9a61-54084d539797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd4eb6ea-e19c-4762-abd3-e7ba6dec5c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:46 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Volume 1fc060a3-3b1e-4a86-943a-fbc3606eb0b2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2', 'volume_size': 2, 'snapshot_id': '5dfd6463-65de-4284-b12f-3acf05929f83'} Apr 16 22:59:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:46 devstack sudo[86311]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2fa39682-e1fa-4746-9cb9-10c78d738777 tempest-GroupSnapshotsV319Test-574987265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.0992aaa6-b2b9-411d-a17a-a99984f34fa7" returned: 0 in 0.529s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:46 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-2fa39682-e1fa-4746-9cb9-10c78d738777 tempest-GroupSnapshotsV319Test-574987265 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.0992aaa6-b2b9-411d-a17a-a99984f34fa7 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 22:59:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2fa39682-e1fa-4746-9cb9-10c78d738777 tempest-GroupSnapshotsV319Test-574987265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.0992aaa6-b2b9-411d-a17a-a99984f34fa7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:46 devstack sudo[86303]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8a03e467-e689-44f3-b681-44928a109735 tempest-VolumesListTestJSON-314958204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d78a50fa-59fc-455e-bffa-a5fce33063f2" returned: 0 in 0.673s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8a03e467-e689-44f3-b681-44928a109735 tempest-VolumesListTestJSON-314958204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d78a50fa-59fc-455e-bffa-a5fce33063f2 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:46 devstack sudo[86319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.0992aaa6-b2b9-411d-a17a-a99984f34fa7 Apr 16 22:59:46 devstack sudo[86319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:46 devstack sudo[86321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d78a50fa-59fc-455e-bffa-a5fce33063f2 Apr 16 22:59:46 devstack sudo[86321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:47 devstack sudo[86319]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2fa39682-e1fa-4746-9cb9-10c78d738777 tempest-GroupSnapshotsV319Test-574987265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.0992aaa6-b2b9-411d-a17a-a99984f34fa7" returned: 0 in 0.462s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2fa39682-e1fa-4746-9cb9-10c78d738777 tempest-GroupSnapshotsV319Test-574987265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:47 devstack sudo[86325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.info Apr 16 22:59:47 devstack sudo[86325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:47 devstack sudo[86321]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8a03e467-e689-44f3-b681-44928a109735 tempest-VolumesListTestJSON-314958204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d78a50fa-59fc-455e-bffa-a5fce33063f2" returned: 0 in 0.491s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:47 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8a03e467-e689-44f3-b681-44928a109735 tempest-VolumesListTestJSON-314958204 None] Lock "cinder-quobyte-d78a50fa-59fc-455e-bffa-a5fce33063f2" released by "delete_volume" :: held 1.199s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:47 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-8a03e467-e689-44f3-b681-44928a109735 tempest-VolumesListTestJSON-314958204 None] Created reservations ['79e6eb93-70ea-472b-8b53-8f21bd2c1dfd', '1db3d65b-080a-452d-a67c-f01ceb5d6e32', '17eae49d-3413-4cf0-b209-29b925f1cfb5', '91a0458f-4874-4465-8b72-960d87418b3d'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:59:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8a03e467-e689-44f3-b681-44928a109735 tempest-VolumesListTestJSON-314958204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8a03e467-e689-44f3-b681-44928a109735 tempest-VolumesListTestJSON-314958204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:47 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-8a03e467-e689-44f3-b681-44928a109735 tempest-VolumesListTestJSON-314958204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:59:47 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-8a03e467-e689-44f3-b681-44928a109735 tempest-VolumesListTestJSON-314958204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:59:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8a03e467-e689-44f3-b681-44928a109735 tempest-VolumesListTestJSON-314958204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8a03e467-e689-44f3-b681-44928a109735 tempest-VolumesListTestJSON-314958204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:47 devstack sudo[86327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:59:47 devstack sudo[86327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:47 devstack sudo[86325]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2fa39682-e1fa-4746-9cb9-10c78d738777 tempest-GroupSnapshotsV319Test-574987265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.info" returned: 0 in 0.468s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:47 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-2fa39682-e1fa-4746-9cb9-10c78d738777 tempest-GroupSnapshotsV319Test-574987265 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 22:59:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2fa39682-e1fa-4746-9cb9-10c78d738777 tempest-GroupSnapshotsV319Test-574987265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:47 devstack sudo[86330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.info Apr 16 22:59:47 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:48 devstack sudo[86327]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8a03e467-e689-44f3-b681-44928a109735 tempest-VolumesListTestJSON-314958204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.468s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-8a03e467-e689-44f3-b681-44928a109735 tempest-VolumesListTestJSON-314958204 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:59:48 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-8a03e467-e689-44f3-b681-44928a109735 tempest-VolumesListTestJSON-314958204 None] Deleted volume successfully. Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8a03e467-e689-44f3-b681-44928a109735 tempest-VolumesListTestJSON-314958204 None] Lock "cinder-d78a50fa-59fc-455e-bffa-a5fce33063f2-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:48 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2fa39682-e1fa-4746-9cb9-10c78d738777 tempest-GroupSnapshotsV319Test-574987265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.info" returned: 0 in 0.515s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2fa39682-e1fa-4746-9cb9-10c78d738777 tempest-GroupSnapshotsV319Test-574987265 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.195s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.633s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "cinder-quobyte-5dfd6463-65de-4284-b12f-3acf05929f83-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2" by "_create_volume_from_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-5dfd6463-65de-4284-b12f-3acf05929f83-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Creating volume 1fc060a3-3b1e-4a86-943a-fbc3606eb0b2 from snapshot 5dfd6463-65de-4284-b12f-3acf05929f83 {{(pid=81971) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "cinder-quobyte-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2" by "_copy_volume_from_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d2bb7604-8ba1-43bb-afa6-fcf3e2be22c5 tempest-VolumesListTestJSON-314958204 None] Acquiring lock "cinder-c2e58e9b-524b-48f6-8b4d-d5be3f8d9077-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] snapshot: 5dfd6463-65de-4284-b12f-3acf05929f83, volume: 1fc060a3-3b1e-4a86-943a-fbc3606eb0b2, {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d2bb7604-8ba1-43bb-afa6-fcf3e2be22c5 tempest-VolumesListTestJSON-314958204 None] Lock "cinder-c2e58e9b-524b-48f6-8b4d-d5be3f8d9077-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb5ab2d-3c6b-4476-a233-7cf03938970a]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.5dfd6463-65de-4284-b12f-3acf05929f83 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:48 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-2fa39682-e1fa-4746-9cb9-10c78d738777 tempest-GroupSnapshotsV319Test-574987265 None] group_snapshot cb22f5a5-e9e7-4020-a221-e3d878e4ca77: created successfully Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d2bb7604-8ba1-43bb-afa6-fcf3e2be22c5 tempest-VolumesListTestJSON-314958204 None] Acquiring lock "cinder-quobyte-c2e58e9b-524b-48f6-8b4d-d5be3f8d9077" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d2bb7604-8ba1-43bb-afa6-fcf3e2be22c5 tempest-VolumesListTestJSON-314958204 None] Lock "cinder-quobyte-c2e58e9b-524b-48f6-8b4d-d5be3f8d9077" acquired by "delete_volume" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd83bfe-f22b-4584-aa1e-6cab7fc7041a]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d2bb7604-8ba1-43bb-afa6-fcf3e2be22c5 tempest-VolumesListTestJSON-314958204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c2e58e9b-524b-48f6-8b4d-d5be3f8d9077 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:48 devstack sudo[86335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.5dfd6463-65de-4284-b12f-3acf05929f83 Apr 16 22:59:48 devstack sudo[86335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:48 devstack sudo[86336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c2e58e9b-524b-48f6-8b4d-d5be3f8d9077 Apr 16 22:59:48 devstack sudo[86336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:49 devstack sudo[86335]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.5dfd6463-65de-4284-b12f-3acf05929f83" returned: 0 in 0.561s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69769a80-2b3c-4143-b85a-5cb5b88f6779(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:59:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779 {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 22:59:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Creating direct copy from snapshot {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 22:59:49 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[048f41b6-0e5d-42ac-8fca-39d126d9f61d]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:49 devstack sudo[86336]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d2bb7604-8ba1-43bb-afa6-fcf3e2be22c5 tempest-VolumesListTestJSON-314958204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c2e58e9b-524b-48f6-8b4d-d5be3f8d9077" returned: 0 in 0.561s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d2bb7604-8ba1-43bb-afa6-fcf3e2be22c5 tempest-VolumesListTestJSON-314958204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c2e58e9b-524b-48f6-8b4d-d5be3f8d9077 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:49 devstack sudo[86352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c2e58e9b-524b-48f6-8b4d-d5be3f8d9077 Apr 16 22:59:49 devstack sudo[86352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:49 devstack sudo[86351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779 Apr 16 22:59:49 devstack sudo[86351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:49 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-d2b9aa79-ccc3-4279-9c9f-2e1585ebc798 tempest-GroupSnapshotsV319Test-574987265 None] group_snapshot cb22f5a5-e9e7-4020-a221-e3d878e4ca77: deleting Apr 16 22:59:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d2b9aa79-ccc3-4279-9c9f-2e1585ebc798 tempest-GroupSnapshotsV319Test-574987265 None] group_snapshot cb22f5a5-e9e7-4020-a221-e3d878e4ca77: deleting {{(pid=81971) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 16 22:59:49 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d2b9aa79-ccc3-4279-9c9f-2e1585ebc798 tempest-GroupSnapshotsV319Test-574987265 None] Acquiring lock "cinder-quobyte-7493da1f-4c23-4c8f-9254-cf59f100c0d9" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:49 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d2b9aa79-ccc3-4279-9c9f-2e1585ebc798 tempest-GroupSnapshotsV319Test-574987265 None] Lock "cinder-quobyte-7493da1f-4c23-4c8f-9254-cf59f100c0d9" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:49 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d2b9aa79-ccc3-4279-9c9f-2e1585ebc798 tempest-GroupSnapshotsV319Test-574987265 None] Acquiring lock "cinder-quobyte-0992aaa6-b2b9-411d-a17a-a99984f34fa7" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:49 devstack sudo[86352]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:49 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d2b9aa79-ccc3-4279-9c9f-2e1585ebc798 tempest-GroupSnapshotsV319Test-574987265 None] Lock "cinder-quobyte-0992aaa6-b2b9-411d-a17a-a99984f34fa7" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-d2b9aa79-ccc3-4279-9c9f-2e1585ebc798 tempest-GroupSnapshotsV319Test-574987265 None] Deleting offline snapshot 0992aaa6-b2b9-411d-a17a-a99984f34fa7 of volume 7493da1f-4c23-4c8f-9254-cf59f100c0d9 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:59:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-d2b9aa79-ccc3-4279-9c9f-2e1585ebc798 tempest-GroupSnapshotsV319Test-574987265 None] snapshot_file for this snap is: volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.0992aaa6-b2b9-411d-a17a-a99984f34fa7 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:59:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d2bb7604-8ba1-43bb-afa6-fcf3e2be22c5 tempest-VolumesListTestJSON-314958204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c2e58e9b-524b-48f6-8b4d-d5be3f8d9077" returned: 0 in 0.695s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:49 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[8679beb5-b87f-426a-b57d-bfec1da7a019]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d2b9aa79-ccc3-4279-9c9f-2e1585ebc798 tempest-GroupSnapshotsV319Test-574987265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.0992aaa6-b2b9-411d-a17a-a99984f34fa7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:49 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d2bb7604-8ba1-43bb-afa6-fcf3e2be22c5 tempest-VolumesListTestJSON-314958204 None] Lock "cinder-quobyte-c2e58e9b-524b-48f6-8b4d-d5be3f8d9077" released by "delete_volume" :: held 1.290s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:49 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-d2bb7604-8ba1-43bb-afa6-fcf3e2be22c5 tempest-VolumesListTestJSON-314958204 None] Created reservations ['4da6d84b-5b8e-46a3-b71d-ab0fd323141e', '6830bd69-de9b-4226-974e-7b2c63164643', '3d8edc85-fab4-408b-847b-d3e6ce479b22', 'f57d76f7-ca94-42c7-8dad-810c1df27baf'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:59:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d2bb7604-8ba1-43bb-afa6-fcf3e2be22c5 tempest-VolumesListTestJSON-314958204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d2bb7604-8ba1-43bb-afa6-fcf3e2be22c5 tempest-VolumesListTestJSON-314958204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d2bb7604-8ba1-43bb-afa6-fcf3e2be22c5 tempest-VolumesListTestJSON-314958204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:59:50 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d2bb7604-8ba1-43bb-afa6-fcf3e2be22c5 tempest-VolumesListTestJSON-314958204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:59:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d2bb7604-8ba1-43bb-afa6-fcf3e2be22c5 tempest-VolumesListTestJSON-314958204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d2bb7604-8ba1-43bb-afa6-fcf3e2be22c5 tempest-VolumesListTestJSON-314958204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:50 devstack sudo[86378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.0992aaa6-b2b9-411d-a17a-a99984f34fa7 Apr 16 22:59:50 devstack sudo[86378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:50 devstack sudo[86351]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779" returned: 0 in 0.891s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:50 devstack sudo[86379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:59:50 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:50 devstack cinder-volume[81971]: DEBUG cinder.utils [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Path /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2 not found in is_blk_device check {{(pid=81971) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 22:59:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:50 devstack sudo[86382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2 Apr 16 22:59:50 devstack sudo[86382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:50 devstack sudo[86378]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d2b9aa79-ccc3-4279-9c9f-2e1585ebc798 tempest-GroupSnapshotsV319Test-574987265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.0992aaa6-b2b9-411d-a17a-a99984f34fa7" returned: 0 in 0.561s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:50 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-d2b9aa79-ccc3-4279-9c9f-2e1585ebc798 tempest-GroupSnapshotsV319Test-574987265 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:59:50 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd68a25-66fc-4987-b8d8-da49e704bd20]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d2b9aa79-ccc3-4279-9c9f-2e1585ebc798 tempest-GroupSnapshotsV319Test-574987265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:50 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d2bb7604-8ba1-43bb-afa6-fcf3e2be22c5 tempest-VolumesListTestJSON-314958204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.494s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:50 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-d2bb7604-8ba1-43bb-afa6-fcf3e2be22c5 tempest-VolumesListTestJSON-314958204 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:59:50 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-d2bb7604-8ba1-43bb-afa6-fcf3e2be22c5 tempest-VolumesListTestJSON-314958204 None] Deleted volume successfully. Apr 16 22:59:50 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d2bb7604-8ba1-43bb-afa6-fcf3e2be22c5 tempest-VolumesListTestJSON-314958204 None] Lock "cinder-c2e58e9b-524b-48f6-8b4d-d5be3f8d9077-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:50 devstack sudo[86389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9 Apr 16 22:59:50 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:52 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d2b9aa79-ccc3-4279-9c9f-2e1585ebc798 tempest-GroupSnapshotsV319Test-574987265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9" returned: 0 in 1.640s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d2b9aa79-ccc3-4279-9c9f-2e1585ebc798 tempest-GroupSnapshotsV319Test-574987265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.0992aaa6-b2b9-411d-a17a-a99984f34fa7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:52 devstack sudo[86410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.0992aaa6-b2b9-411d-a17a-a99984f34fa7 Apr 16 22:59:52 devstack sudo[86410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:52 devstack cinder-volume[81971]: INFO cinder.volume.manager [req-7dff426a-8137-46aa-85e8-69761a982f96 req-27ba6b9c-aaae-46bc-9215-b19a1a59ce28 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Terminate volume connection completed successfully. Apr 16 22:59:52 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-7dff426a-8137-46aa-85e8-69761a982f96 req-27ba6b9c-aaae-46bc-9215-b19a1a59ce28 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Deleting attachment 5a781bb1-8bc2-4eea-93a9-8be5e19ee460. {{(pid=81971) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 16 22:59:53 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-7dff426a-8137-46aa-85e8-69761a982f96 req-9693c64d-77da-4635-b75a-d879f72163e2 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Acquiring lock "cinder-d8d94658-23e2-4065-8176-c7f022f9200f-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:53 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-7dff426a-8137-46aa-85e8-69761a982f96 req-9693c64d-77da-4635-b75a-d879f72163e2 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Lock "cinder-d8d94658-23e2-4065-8176-c7f022f9200f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:53 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-7dff426a-8137-46aa-85e8-69761a982f96 req-9693c64d-77da-4635-b75a-d879f72163e2 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Acquiring lock "cinder-quobyte-d8d94658-23e2-4065-8176-c7f022f9200f" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:53 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-7dff426a-8137-46aa-85e8-69761a982f96 req-9693c64d-77da-4635-b75a-d879f72163e2 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Lock "cinder-quobyte-d8d94658-23e2-4065-8176-c7f022f9200f" acquired by "delete_volume" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:53 devstack sudo[86382]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2" returned: 0 in 3.735s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:53 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20d783f-625a-437b-b0d7-5f44e01649e7]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:53 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2e120f-f784-4bb0-81f0-4c36122069ad]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-7dff426a-8137-46aa-85e8-69761a982f96 req-9693c64d-77da-4635-b75a-d879f72163e2 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d8d94658-23e2-4065-8176-c7f022f9200f {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:53 devstack sudo[86416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d8d94658-23e2-4065-8176-c7f022f9200f Apr 16 22:59:53 devstack sudo[86416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:53 devstack sudo[86417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779 Apr 16 22:59:53 devstack sudo[86417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:53 devstack sudo[86410]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d2b9aa79-ccc3-4279-9c9f-2e1585ebc798 tempest-GroupSnapshotsV319Test-574987265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.0992aaa6-b2b9-411d-a17a-a99984f34fa7" returned: 0 in 1.852s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d2b9aa79-ccc3-4279-9c9f-2e1585ebc798 tempest-GroupSnapshotsV319Test-574987265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.0992aaa6-b2b9-411d-a17a-a99984f34fa7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:54 devstack sudo[86420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.0992aaa6-b2b9-411d-a17a-a99984f34fa7 Apr 16 22:59:54 devstack sudo[86420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:54 devstack sudo[86416]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-7dff426a-8137-46aa-85e8-69761a982f96 req-9693c64d-77da-4635-b75a-d879f72163e2 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d8d94658-23e2-4065-8176-c7f022f9200f" returned: 0 in 0.719s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-7dff426a-8137-46aa-85e8-69761a982f96 req-9693c64d-77da-4635-b75a-d879f72163e2 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d8d94658-23e2-4065-8176-c7f022f9200f {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:54 devstack sudo[86427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d8d94658-23e2-4065-8176-c7f022f9200f Apr 16 22:59:54 devstack sudo[86427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:54 devstack sudo[86417]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779" returned: 0 in 0.873s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:54 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Image conversion details: src /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779, size 1024.00 MB, duration 3.74 sec, destination /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2 {{(pid=81971) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 22:59:54 devstack cinder-volume[81971]: INFO cinder.image.image_utils [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Converted 1024.00 MB image at 274.08 MB/s Apr 16 22:59:54 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2 is being set with open permissions: ugo+rw Apr 16 22:59:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:54 devstack sudo[86431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2 Apr 16 22:59:54 devstack sudo[86431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:54 devstack sudo[86420]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d2b9aa79-ccc3-4279-9c9f-2e1585ebc798 tempest-GroupSnapshotsV319Test-574987265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9.0992aaa6-b2b9-411d-a17a-a99984f34fa7" returned: 0 in 0.809s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:54 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d2b9aa79-ccc3-4279-9c9f-2e1585ebc798 tempest-GroupSnapshotsV319Test-574987265 None] Lock "cinder-quobyte-0992aaa6-b2b9-411d-a17a-a99984f34fa7" released by "_delete_snapshot" :: held 4.972s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:54 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d2b9aa79-ccc3-4279-9c9f-2e1585ebc798 tempest-GroupSnapshotsV319Test-574987265 None] Lock "cinder-quobyte-7493da1f-4c23-4c8f-9254-cf59f100c0d9" released by "delete_snapshot" :: held 5.009s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:54 devstack cinder-volume[81971]: WARNING cinder.quota [None req-d2b9aa79-ccc3-4279-9c9f-2e1585ebc798 tempest-GroupSnapshotsV319Test-574987265 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1259680788 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1259680788, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:59:54 devstack cinder-volume[81971]: WARNING cinder.quota [None req-d2b9aa79-ccc3-4279-9c9f-2e1585ebc798 tempest-GroupSnapshotsV319Test-574987265 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1259680788 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1259680788, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:59:54 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-d2b9aa79-ccc3-4279-9c9f-2e1585ebc798 tempest-GroupSnapshotsV319Test-574987265 None] Created reservations ['83b49897-5791-4b46-aa0f-a52247146e94', '27be25db-7ae4-4e2a-8066-c8777b0cffd5', '4a5a8619-2f73-4ff1-bbf1-ccf4deda8234', '62dc2ebd-77e9-4982-a946-329635864223'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:59:54 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-d2b9aa79-ccc3-4279-9c9f-2e1585ebc798 tempest-GroupSnapshotsV319Test-574987265 None] group_snapshot cb22f5a5-e9e7-4020-a221-e3d878e4ca77: deleted successfully Apr 16 22:59:55 devstack sudo[86427]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-7dff426a-8137-46aa-85e8-69761a982f96 req-9693c64d-77da-4635-b75a-d879f72163e2 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d8d94658-23e2-4065-8176-c7f022f9200f" returned: 0 in 0.615s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-7dff426a-8137-46aa-85e8-69761a982f96 req-9693c64d-77da-4635-b75a-d879f72163e2 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Lock "cinder-quobyte-d8d94658-23e2-4065-8176-c7f022f9200f" released by "delete_volume" :: held 1.381s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.quota [req-7dff426a-8137-46aa-85e8-69761a982f96 req-9693c64d-77da-4635-b75a-d879f72163e2 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Created reservations ['1d8354f5-5b0a-4bcc-99e2-92e75a965be8', 'f9a176a1-08e1-4d91-8b0d-383a0d05c50e', '43142b82-64ae-4b1d-ac2d-d29bea7a71b1', 'a8b05def-5351-44bc-be75-b9c046ff4a48'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-7dff426a-8137-46aa-85e8-69761a982f96 req-9693c64d-77da-4635-b75a-d879f72163e2 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-7dff426a-8137-46aa-85e8-69761a982f96 req-9693c64d-77da-4635-b75a-d879f72163e2 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-7dff426a-8137-46aa-85e8-69761a982f96 req-9693c64d-77da-4635-b75a-d879f72163e2 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-7dff426a-8137-46aa-85e8-69761a982f96 req-9693c64d-77da-4635-b75a-d879f72163e2 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-7dff426a-8137-46aa-85e8-69761a982f96 req-9693c64d-77da-4635-b75a-d879f72163e2 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-7dff426a-8137-46aa-85e8-69761a982f96 req-9693c64d-77da-4635-b75a-d879f72163e2 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:55 devstack sudo[86435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:59:55 devstack sudo[86435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:55 devstack sudo[86431]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2" returned: 0 in 0.739s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2" released by "_copy_volume_from_snapshot" :: held 6.930s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-5dfd6463-65de-4284-b12f-3acf05929f83-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2" released by "_create_volume_from_snapshot" :: held 6.967s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.989s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd4eb6ea-e19c-4762-abd3-e7ba6dec5c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2', 'volume_size': 2, 'snapshot_id': '5dfd6463-65de-4284-b12f-3acf05929f83'}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c5c6ff-1b10-46f1-9f06-6728cea9a444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:55 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Volume volume-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2 (1fc060a3-3b1e-4a86-943a-fbc3606eb0b2): created successfully Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c5c6ff-1b10-46f1-9f06-6728cea9a444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Flow 'volume_create_manager' (f0c3eebf-92d1-438a-a55c-921f8911ee6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:59:55 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-ec529e1a-d0ce-4b0d-9a57-5ae2da286750 tempest-VolumesSnapshotTestJSON-1853747142 None] Created volume successfully. Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-aa72512d-0244-416e-a4bf-cbf036116709 tempest-GroupSnapshotsV319Test-574987265 None] Acquiring lock "cinder-quobyte-7493da1f-4c23-4c8f-9254-cf59f100c0d9" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-aa72512d-0244-416e-a4bf-cbf036116709 tempest-GroupSnapshotsV319Test-574987265 None] Lock "cinder-quobyte-7493da1f-4c23-4c8f-9254-cf59f100c0d9" acquired by "delete_volume" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Flow 'volume_create_manager' (b22fe654-7e2a-4b84-8b32-246bddb628e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2e00bd-3f0e-4f6d-b9c7-284f3591eb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4568679-1933-4dd4-96b2-1906300bedf3]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-aa72512d-0244-416e-a4bf-cbf036116709 tempest-GroupSnapshotsV319Test-574987265 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be2e00bd-3f0e-4f6d-b9c7-284f3591eb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1215234693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc7828a8-4b56-45e0-ba74-160752e109c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcd4fbd86f304e75b3c934e45d3b71e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:59:56Z,use_quota=True,user_id='3f12c3824d9141e79f926b0b204cf813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7f20c7-8bc0-44ba-be1d-337a8f607712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7f20c7-8bc0-44ba-be1d-337a8f607712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e12fac37-2758-4aff-a10f-d135d8ea830d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e12fac37-2758-4aff-a10f-d135d8ea830d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc7828a8-4b56-45e0-ba74-160752e109c9', 'volume_name': 'volume-bc7828a8-4b56-45e0-ba74-160752e109c9', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8e0e10-6886-4dfd-b7d7-dfaed760e6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea8e0e10-6886-4dfd-b7d7-dfaed760e6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1769854-d252-4c22-8f57-4c76728664b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:55 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Volume bc7828a8-4b56-45e0-ba74-160752e109c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc7828a8-4b56-45e0-ba74-160752e109c9', 'volume_size': 1} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T20:59:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1215234693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc7828a8-4b56-45e0-ba74-160752e109c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcd4fbd86f304e75b3c934e45d3b71e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T20:59:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T20:59:56Z,use_quota=True,user_id='3f12c3824d9141e79f926b0b204cf813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Creating volume bc7828a8-4b56-45e0-ba74-160752e109c9 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 22:59:55 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bc7828a8-4b56-45e0-ba74-160752e109c9 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f47acf7f-a1d1-4bcf-8624-5957f9b7dd8f tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "cinder-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f47acf7f-a1d1-4bcf-8624-5957f9b7dd8f tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:55 devstack sudo[86437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9 Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f47acf7f-a1d1-4bcf-8624-5957f9b7dd8f tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "cinder-quobyte-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:55 devstack sudo[86437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:55 devstack sudo[86439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bc7828a8-4b56-45e0-ba74-160752e109c9 1073741824 Apr 16 22:59:55 devstack sudo[86439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f47acf7f-a1d1-4bcf-8624-5957f9b7dd8f tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2" acquired by "delete_volume" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5bfae9-3d52-4e19-b5c1-108de827f2d8]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f47acf7f-a1d1-4bcf-8624-5957f9b7dd8f tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:56 devstack sudo[86442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2 Apr 16 22:59:56 devstack sudo[86442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:56 devstack sudo[86435]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-7dff426a-8137-46aa-85e8-69761a982f96 req-9693c64d-77da-4635-b75a-d879f72163e2 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.741s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:56 devstack cinder-volume[81971]: DEBUG cinder.manager [req-7dff426a-8137-46aa-85e8-69761a982f96 req-9693c64d-77da-4635-b75a-d879f72163e2 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:59:56 devstack cinder-volume[81971]: INFO cinder.volume.manager [req-7dff426a-8137-46aa-85e8-69761a982f96 req-9693c64d-77da-4635-b75a-d879f72163e2 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Deleted volume successfully. Apr 16 22:59:56 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-7dff426a-8137-46aa-85e8-69761a982f96 req-9693c64d-77da-4635-b75a-d879f72163e2 tempest-ServerBootFromVolumeStableRescueTest-347087810 None] Lock "cinder-d8d94658-23e2-4065-8176-c7f022f9200f-delete_volume" released by "delete_volume" :: held 2.356s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:56 devstack sudo[86437]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-aa72512d-0244-416e-a4bf-cbf036116709 tempest-GroupSnapshotsV319Test-574987265 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9" returned: 0 in 0.731s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-aa72512d-0244-416e-a4bf-cbf036116709 tempest-GroupSnapshotsV319Test-574987265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:56 devstack sudo[86452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9 Apr 16 22:59:56 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:56 devstack sudo[86439]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bc7828a8-4b56-45e0-ba74-160752e109c9 1073741824" returned: 0 in 0.764s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bc7828a8-4b56-45e0-ba74-160752e109c9 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:56 devstack sudo[86455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bc7828a8-4b56-45e0-ba74-160752e109c9 Apr 16 22:59:56 devstack sudo[86455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:56 devstack sudo[86442]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f47acf7f-a1d1-4bcf-8624-5957f9b7dd8f tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2" returned: 0 in 0.736s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f47acf7f-a1d1-4bcf-8624-5957f9b7dd8f tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:56 devstack sudo[86457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2 Apr 16 22:59:56 devstack sudo[86457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:56 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-aa72512d-0244-416e-a4bf-cbf036116709 tempest-GroupSnapshotsV319Test-574987265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7493da1f-4c23-4c8f-9254-cf59f100c0d9" returned: 0 in 0.497s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:56 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-aa72512d-0244-416e-a4bf-cbf036116709 tempest-GroupSnapshotsV319Test-574987265 None] Lock "cinder-quobyte-7493da1f-4c23-4c8f-9254-cf59f100c0d9" released by "delete_volume" :: held 1.311s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-aa72512d-0244-416e-a4bf-cbf036116709 tempest-GroupSnapshotsV319Test-574987265 None] Created reservations ['f27348cd-de40-4be3-b1e5-9d1e7f4d503f'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:59:57 devstack cinder-volume[81971]: WARNING cinder.quota [None req-aa72512d-0244-416e-a4bf-cbf036116709 tempest-GroupSnapshotsV319Test-574987265 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1259680788 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1259680788, it is now deprecated. Please use the default quota class for default quota. Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-aa72512d-0244-416e-a4bf-cbf036116709 tempest-GroupSnapshotsV319Test-574987265 None] Created reservations ['cebe50ff-f014-49f0-b812-6913cec7c541', 'f43f546f-1891-42a5-8abb-b03f8fb18d5f', '561d6817-fa9a-4525-a94f-cfa5e6029ed9', '3afbc142-6b74-413e-8f85-fa8708154b74'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:59:57 devstack sudo[86455]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bc7828a8-4b56-45e0-ba74-160752e109c9" returned: 0 in 0.523s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.338s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1769854-d252-4c22-8f57-4c76728664b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc7828a8-4b56-45e0-ba74-160752e109c9', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f0f08a-25f4-4ee2-ac75-35d9f17375c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 22:59:57 devstack sudo[86457]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f47acf7f-a1d1-4bcf-8624-5957f9b7dd8f tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2" returned: 0 in 0.527s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:57 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Volume volume-bc7828a8-4b56-45e0-ba74-160752e109c9 (bc7828a8-4b56-45e0-ba74-160752e109c9): created successfully Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f0f08a-25f4-4ee2-ac75-35d9f17375c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Flow 'volume_create_manager' (b22fe654-7e2a-4b84-8b32-246bddb628e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f47acf7f-a1d1-4bcf-8624-5957f9b7dd8f tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2" released by "delete_volume" :: held 1.310s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:57 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-081aa8b0-74c4-4487-add0-7e7a6dddd3b7 tempest-VolumesNegativeTest-848299870 None] Created volume successfully. Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-aa72512d-0244-416e-a4bf-cbf036116709 tempest-GroupSnapshotsV319Test-574987265 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-aa72512d-0244-416e-a4bf-cbf036116709 tempest-GroupSnapshotsV319Test-574987265 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-aa72512d-0244-416e-a4bf-cbf036116709 tempest-GroupSnapshotsV319Test-574987265 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-aa72512d-0244-416e-a4bf-cbf036116709 tempest-GroupSnapshotsV319Test-574987265 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-aa72512d-0244-416e-a4bf-cbf036116709 tempest-GroupSnapshotsV319Test-574987265 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-aa72512d-0244-416e-a4bf-cbf036116709 tempest-GroupSnapshotsV319Test-574987265 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-f47acf7f-a1d1-4bcf-8624-5957f9b7dd8f tempest-VolumesSnapshotTestJSON-1853747142 None] Created reservations ['90cbca33-6d73-4744-879a-9f25d7aac58d', 'd1fd3522-5260-4087-bf71-8b72ed431c9a', '0d637993-8f57-47bc-8c50-6b927dbb350d', '3f4686e2-7dd5-4254-ada3-8a60a1ea77aa'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 22:59:57 devstack sudo[86462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:59:57 devstack sudo[86462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f47acf7f-a1d1-4bcf-8624-5957f9b7dd8f tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f47acf7f-a1d1-4bcf-8624-5957f9b7dd8f tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-f47acf7f-a1d1-4bcf-8624-5957f9b7dd8f tempest-VolumesSnapshotTestJSON-1853747142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-f47acf7f-a1d1-4bcf-8624-5957f9b7dd8f tempest-VolumesSnapshotTestJSON-1853747142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f47acf7f-a1d1-4bcf-8624-5957f9b7dd8f tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f47acf7f-a1d1-4bcf-8624-5957f9b7dd8f tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:57 devstack sudo[86464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 22:59:57 devstack sudo[86464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:57 devstack sudo[86464]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f47acf7f-a1d1-4bcf-8624-5957f9b7dd8f tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.509s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-f47acf7f-a1d1-4bcf-8624-5957f9b7dd8f tempest-VolumesSnapshotTestJSON-1853747142 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:59:57 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-f47acf7f-a1d1-4bcf-8624-5957f9b7dd8f tempest-VolumesSnapshotTestJSON-1853747142 None] Deleted volume successfully. Apr 16 22:59:57 devstack sudo[86462]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-aa72512d-0244-416e-a4bf-cbf036116709 tempest-GroupSnapshotsV319Test-574987265 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.590s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-aa72512d-0244-416e-a4bf-cbf036116709 tempest-GroupSnapshotsV319Test-574987265 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 22:59:57 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-aa72512d-0244-416e-a4bf-cbf036116709 tempest-GroupSnapshotsV319Test-574987265 None] Delete group completed successfully. Apr 16 22:59:57 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f47acf7f-a1d1-4bcf-8624-5957f9b7dd8f tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-1fc060a3-3b1e-4a86-943a-fbc3606eb0b2-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 22:59:58 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bb927792-b44e-48a1-be13-11205fcf328c tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "cinder-5dfd6463-65de-4284-b12f-3acf05929f83-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:58 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bb927792-b44e-48a1-be13-11205fcf328c tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-5dfd6463-65de-4284-b12f-3acf05929f83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:58 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bb927792-b44e-48a1-be13-11205fcf328c tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "cinder-quobyte-69769a80-2b3c-4143-b85a-5cb5b88f6779" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:58 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bb927792-b44e-48a1-be13-11205fcf328c tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-69769a80-2b3c-4143-b85a-5cb5b88f6779" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:58 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bb927792-b44e-48a1-be13-11205fcf328c tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "cinder-quobyte-5dfd6463-65de-4284-b12f-3acf05929f83" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 22:59:58 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bb927792-b44e-48a1-be13-11205fcf328c tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-5dfd6463-65de-4284-b12f-3acf05929f83" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 22:59:58 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-bb927792-b44e-48a1-be13-11205fcf328c tempest-VolumesSnapshotTestJSON-1853747142 None] Deleting offline snapshot 5dfd6463-65de-4284-b12f-3acf05929f83 of volume 69769a80-2b3c-4143-b85a-5cb5b88f6779 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 22:59:58 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-bb927792-b44e-48a1-be13-11205fcf328c tempest-VolumesSnapshotTestJSON-1853747142 None] snapshot_file for this snap is: volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.5dfd6463-65de-4284-b12f-3acf05929f83 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 22:59:58 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6c6845-c257-43a8-95e3-58d522992e86]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bb927792-b44e-48a1-be13-11205fcf328c tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.5dfd6463-65de-4284-b12f-3acf05929f83 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:58 devstack sudo[86501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.5dfd6463-65de-4284-b12f-3acf05929f83 Apr 16 22:59:58 devstack sudo[86501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:58 devstack sudo[86501]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bb927792-b44e-48a1-be13-11205fcf328c tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.5dfd6463-65de-4284-b12f-3acf05929f83" returned: 0 in 0.795s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:58 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-bb927792-b44e-48a1-be13-11205fcf328c tempest-VolumesSnapshotTestJSON-1853747142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-69769a80-2b3c-4143-b85a-5cb5b88f6779(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 22:59:58 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[b226c3f7-c4f0-43c3-80d4-48fa5eb2c9bf]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 22:59:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bb927792-b44e-48a1-be13-11205fcf328c tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:59 devstack sudo[86541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779 Apr 16 22:59:59 devstack sudo[86541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 22:59:59 devstack sudo[86541]: pam_unix(sudo:session): session closed for user root Apr 16 22:59:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bb927792-b44e-48a1-be13-11205fcf328c tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779" returned: 0 in 0.738s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 22:59:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bb927792-b44e-48a1-be13-11205fcf328c tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.5dfd6463-65de-4284-b12f-3acf05929f83 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 22:59:59 devstack sudo[86549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.5dfd6463-65de-4284-b12f-3acf05929f83 Apr 16 22:59:59 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:00 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bb927792-b44e-48a1-be13-11205fcf328c tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.5dfd6463-65de-4284-b12f-3acf05929f83" returned: 0 in 0.727s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bb927792-b44e-48a1-be13-11205fcf328c tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.5dfd6463-65de-4284-b12f-3acf05929f83 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:00 devstack sudo[86556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.5dfd6463-65de-4284-b12f-3acf05929f83 Apr 16 23:00:00 devstack sudo[86556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:00 devstack sudo[86556]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bb927792-b44e-48a1-be13-11205fcf328c tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779.5dfd6463-65de-4284-b12f-3acf05929f83" returned: 0 in 0.521s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bb927792-b44e-48a1-be13-11205fcf328c tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-5dfd6463-65de-4284-b12f-3acf05929f83" released by "_delete_snapshot" :: held 2.861s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:00:01 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bb927792-b44e-48a1-be13-11205fcf328c tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-69769a80-2b3c-4143-b85a-5cb5b88f6779" released by "delete_snapshot" :: held 2.890s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:00:01 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-bb927792-b44e-48a1-be13-11205fcf328c tempest-VolumesSnapshotTestJSON-1853747142 None] Created reservations ['2d9dbc22-08a8-4dbb-a17b-e18241e426a5', 'b8ad8103-0c25-4d87-bc83-e02195b4b3ae', '9440db19-98f1-4a9d-bb9b-55f446cb877b', '92df7abf-81ff-43ed-99b9-51e8c219ae8a'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:00:01 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-bb927792-b44e-48a1-be13-11205fcf328c tempest-VolumesSnapshotTestJSON-1853747142 None] Delete snapshot completed successfully. Apr 16 23:00:01 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bb927792-b44e-48a1-be13-11205fcf328c tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-5dfd6463-65de-4284-b12f-3acf05929f83-delete_snapshot" released by "delete_snapshot" :: held 3.029s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:00:01 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b076242c-0dcb-4322-9062-e6a86e865bba tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "cinder-69769a80-2b3c-4143-b85a-5cb5b88f6779-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:00:01 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b076242c-0dcb-4322-9062-e6a86e865bba tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-69769a80-2b3c-4143-b85a-5cb5b88f6779-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:00:01 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b076242c-0dcb-4322-9062-e6a86e865bba tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "cinder-quobyte-69769a80-2b3c-4143-b85a-5cb5b88f6779" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:00:01 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b076242c-0dcb-4322-9062-e6a86e865bba tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-69769a80-2b3c-4143-b85a-5cb5b88f6779" acquired by "delete_volume" :: waited 0.014s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:00:01 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bfffa2-9221-4ced-a1ff-cb2fd6470aac]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:00:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b076242c-0dcb-4322-9062-e6a86e865bba tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:01 devstack sudo[86560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779 Apr 16 23:00:01 devstack sudo[86560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:02 devstack sudo[86560]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b076242c-0dcb-4322-9062-e6a86e865bba tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779" returned: 0 in 0.684s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b076242c-0dcb-4322-9062-e6a86e865bba tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:02 devstack sudo[86566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779 Apr 16 23:00:02 devstack sudo[86566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:02 devstack sudo[86566]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b076242c-0dcb-4322-9062-e6a86e865bba tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-69769a80-2b3c-4143-b85a-5cb5b88f6779" returned: 0 in 0.601s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b076242c-0dcb-4322-9062-e6a86e865bba tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-69769a80-2b3c-4143-b85a-5cb5b88f6779" released by "delete_volume" :: held 1.323s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:00:02 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-b076242c-0dcb-4322-9062-e6a86e865bba tempest-VolumesSnapshotTestJSON-1853747142 None] Created reservations ['c19b4863-284b-4c54-aafb-b979ccb1fe5c', '8c78fd4a-6c48-48e0-99a3-312e7cc66d7b', 'fe27a698-d34d-46d3-bedf-03423d4834eb', '69967b53-d739-495c-9dfd-3547c5956148'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:00:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b076242c-0dcb-4322-9062-e6a86e865bba tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b076242c-0dcb-4322-9062-e6a86e865bba tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:02 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b076242c-0dcb-4322-9062-e6a86e865bba tempest-VolumesSnapshotTestJSON-1853747142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:00:02 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b076242c-0dcb-4322-9062-e6a86e865bba tempest-VolumesSnapshotTestJSON-1853747142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:00:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b076242c-0dcb-4322-9062-e6a86e865bba tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b076242c-0dcb-4322-9062-e6a86e865bba tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:02 devstack sudo[86569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:00:02 devstack sudo[86569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:03 devstack sudo[86569]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b076242c-0dcb-4322-9062-e6a86e865bba tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.762s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:03 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-b076242c-0dcb-4322-9062-e6a86e865bba tempest-VolumesSnapshotTestJSON-1853747142 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:00:03 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-b076242c-0dcb-4322-9062-e6a86e865bba tempest-VolumesSnapshotTestJSON-1853747142 None] Deleted volume successfully. Apr 16 23:00:03 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b076242c-0dcb-4322-9062-e6a86e865bba tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-69769a80-2b3c-4143-b85a-5cb5b88f6779-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Flow 'volume_create_manager' (790c69f2-b695-4216-843f-7bbeefa7ec39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2860e2-89f4-402a-aea7-65bca27dbb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:SELECT=175,cinder:INSERT=48,cinder:UPDATE=204,cinder:DELETE=13 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2860e2-89f4-402a-aea7-65bca27dbb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1877399343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f52a8c-1f51-4992-b157-8a3e70e5108d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95769188ca74a1086bac8f54eb7ca25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:00:04Z,use_quota=True,user_id='25a8c52cd1de40919e7c2f6c19b827e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf4a4e35-17c7-4d36-aca1-8df69a0f5612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf4a4e35-17c7-4d36-aca1-8df69a0f5612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa3fe83-88ef-4926-95a0-b6b03b4deee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aa3fe83-88ef-4926-95a0-b6b03b4deee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0f52a8c-1f51-4992-b157-8a3e70e5108d', 'volume_name': 'volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d690870a-a6e1-49d6-a2f0-adb2103439e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d690870a-a6e1-49d6-a2f0-adb2103439e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb1f2cb9-7977-4e0f-acfc-106dcf015197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:04 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Volume a0f52a8c-1f51-4992-b157-8a3e70e5108d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d', 'volume_size': 1} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:00:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1877399343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f52a8c-1f51-4992-b157-8a3e70e5108d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95769188ca74a1086bac8f54eb7ca25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:00:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:00:04Z,use_quota=True,user_id='25a8c52cd1de40919e7c2f6c19b827e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Creating volume a0f52a8c-1f51-4992-b157-8a3e70e5108d {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:00:04 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:04 devstack sudo[86572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d 1073741824 Apr 16 23:00:04 devstack sudo[86572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG oslo_service.periodic_task [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81971) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:04 devstack sudo[86577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:00:04 devstack sudo[86577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:05 devstack sudo[86572]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d 1073741824" returned: 0 in 0.712s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:05 devstack sudo[86583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d Apr 16 23:00:05 devstack sudo[86583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:05 devstack sudo[86577]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.658s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:05 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:00:05 devstack sudo[86583]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d" returned: 0 in 0.772s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:05 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:00:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb1f2cb9-7977-4e0f-acfc-106dcf015197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4c9542-b318-4e0e-a948-97d246c2ad22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:05 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Volume volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d (a0f52a8c-1f51-4992-b157-8a3e70e5108d): created successfully Apr 16 23:00:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af4c9542-b318-4e0e-a948-97d246c2ad22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Flow 'volume_create_manager' (790c69f2-b695-4216-843f-7bbeefa7ec39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:00:05 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-94b0dc5b-5f2c-49b1-b622-80e45dc266fa tempest-VolumesSnapshotTestJSON-1853747142 None] Created volume successfully. Apr 16 23:00:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-57f77ae4-7479-41e7-92ca-f13fd5a104ac tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-57f77ae4-7479-41e7-92ca-f13fd5a104ac tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-57f77ae4-7479-41e7-92ca-f13fd5a104ac tempest-VolumesSnapshotTestJSON-1853747142 None] Creating offline snapshot 39602ed7-2b7b-4989-9cee-7ec2556a17af of volume a0f52a8c-1f51-4992-b157-8a3e70e5108d {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:00:06 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e98d1ba-050b-4f63-9f19-cc4b7e3c69bb]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:00:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-57f77ae4-7479-41e7-92ca-f13fd5a104ac tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:06 devstack sudo[86600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d Apr 16 23:00:06 devstack sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:07 devstack sudo[86600]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-57f77ae4-7479-41e7-92ca-f13fd5a104ac tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d" returned: 0 in 0.718s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-57f77ae4-7479-41e7-92ca-f13fd5a104ac tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.39602ed7-2b7b-4989-9cee-7ec2556a17af 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:07 devstack sudo[86606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.39602ed7-2b7b-4989-9cee-7ec2556a17af 1G Apr 16 23:00:07 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:07 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-91bb3b13-ef8c-4634-8bf7-ecf0982e618d tempest-GroupsV314Test-880213091 None] Group tempest-GroupsV314Test-Group-1672742910: creating Apr 16 23:00:07 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-91bb3b13-ef8c-4634-8bf7-ecf0982e618d tempest-GroupsV314Test-880213091 None] Group tempest-GroupsV314Test-Group-1672742910: created successfully Apr 16 23:00:07 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-91bb3b13-ef8c-4634-8bf7-ecf0982e618d tempest-GroupsV314Test-880213091 None] Create group completed successfully. Apr 16 23:00:07 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-57f77ae4-7479-41e7-92ca-f13fd5a104ac tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.39602ed7-2b7b-4989-9cee-7ec2556a17af 1G" returned: 0 in 0.671s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-57f77ae4-7479-41e7-92ca-f13fd5a104ac tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.39602ed7-2b7b-4989-9cee-7ec2556a17af {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:07 devstack sudo[86611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.39602ed7-2b7b-4989-9cee-7ec2556a17af Apr 16 23:00:07 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:08 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-57f77ae4-7479-41e7-92ca-f13fd5a104ac tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.39602ed7-2b7b-4989-9cee-7ec2556a17af" returned: 0 in 0.587s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:08 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-57f77ae4-7479-41e7-92ca-f13fd5a104ac tempest-VolumesSnapshotTestJSON-1853747142 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.39602ed7-2b7b-4989-9cee-7ec2556a17af is being set with open permissions: ugo+rw Apr 16 23:00:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-57f77ae4-7479-41e7-92ca-f13fd5a104ac tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.39602ed7-2b7b-4989-9cee-7ec2556a17af {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:08 devstack sudo[86616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.39602ed7-2b7b-4989-9cee-7ec2556a17af Apr 16 23:00:08 devstack sudo[86616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:08 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:00:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Flow 'volume_create_manager' (2bd6b1f8-b74d-42a6-9960-c28710e16972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:00:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048754d7-fb38-45a3-a6cd-f4ce1e7e610c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048754d7-fb38-45a3-a6cd-f4ce1e7e610c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-6389661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=52414a19-b6df-473f-87aa-5c28333a4a19,host='devstack@QuobyteHD#QuobyteHD',id=f74dd9ca-92eb-40a0-ba0b-5f92176db90e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2b6831dd754507802764ff890fe582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:00:09Z,use_quota=True,user_id='90432143a6444d98ae0e2e0f105ad1d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8b0b854-ac3c-4879-9356-42d30e5a21c5),volume_type_id=d8b0b854-ac3c-4879-9356-42d30e5a21c5)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24cf1700-cc76-4206-b695-a08da929a40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24cf1700-cc76-4206-b695-a08da929a40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81eb3d69-5300-421d-b34d-a6c93420e7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81eb3d69-5300-421d-b34d-a6c93420e7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f74dd9ca-92eb-40a0-ba0b-5f92176db90e', 'volume_name': 'volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da43799-d431-4cd8-b904-94889ad30b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7da43799-d431-4cd8-b904-94889ad30b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6064872-db8d-45ca-a7b7-f2e4b497e25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:08 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Volume f74dd9ca-92eb-40a0-ba0b-5f92176db90e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e', 'volume_size': 1} Apr 16 23:00:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:09 devstack sudo[86616]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-57f77ae4-7479-41e7-92ca-f13fd5a104ac tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.39602ed7-2b7b-4989-9cee-7ec2556a17af" returned: 0 in 0.665s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-57f77ae4-7479-41e7-92ca-f13fd5a104ac tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:09 devstack sudo[86623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.info Apr 16 23:00:09 devstack sudo[86623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:09 devstack sudo[86623]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-57f77ae4-7479-41e7-92ca-f13fd5a104ac tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.info" returned: 0 in 0.592s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:09 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-57f77ae4-7479-41e7-92ca-f13fd5a104ac tempest-VolumesSnapshotTestJSON-1853747142 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.info is being set with open permissions: ugo+rw Apr 16 23:00:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-57f77ae4-7479-41e7-92ca-f13fd5a104ac tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:09 devstack sudo[86626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.info Apr 16 23:00:09 devstack sudo[86626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:10 devstack sudo[86626]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-57f77ae4-7479-41e7-92ca-f13fd5a104ac tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.info" returned: 0 in 0.520s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-57f77ae4-7479-41e7-92ca-f13fd5a104ac tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.831s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.549s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=52414a19-b6df-473f-87aa-5c28333a4a19,created_at=2026-04-16T21:00:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-6389661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=52414a19-b6df-473f-87aa-5c28333a4a19,host='devstack@QuobyteHD#QuobyteHD',id=f74dd9ca-92eb-40a0-ba0b-5f92176db90e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a2b6831dd754507802764ff890fe582',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:00:09Z,use_quota=True,user_id='90432143a6444d98ae0e2e0f105ad1d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8b0b854-ac3c-4879-9356-42d30e5a21c5),volume_type_id=d8b0b854-ac3c-4879-9356-42d30e5a21c5)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:00:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Creating volume f74dd9ca-92eb-40a0-ba0b-5f92176db90e {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:00:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:00:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:00:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:00:10 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:00:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:10 devstack sudo[86629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e 1073741824 Apr 16 23:00:10 devstack sudo[86629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:10 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-57f77ae4-7479-41e7-92ca-f13fd5a104ac tempest-VolumesSnapshotTestJSON-1853747142 None] Create snapshot completed successfully Apr 16 23:00:11 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:00:11 devstack sudo[86629]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e 1073741824" returned: 0 in 1.305s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Flow 'volume_create_manager' (5efcc9e9-f700-44b5-9a2c-a2c015688afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:00:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (172d287c-123e-4b00-91ad-921381561313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (172d287c-123e-4b00-91ad-921381561313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1755559302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf3f40d-6a8d-4904-a052-404d6171f187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95769188ca74a1086bac8f54eb7ca25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:00:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=39602ed7-2b7b-4989-9cee-7ec2556a17af,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:00:12Z,use_quota=True,user_id='25a8c52cd1de40919e7c2f6c19b827e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33092271-4398-4748-a868-d1e7ef668013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33092271-4398-4748-a868-d1e7ef668013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b7303d-1abc-415c-8d07-470c8cb62786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b7303d-1abc-415c-8d07-470c8cb62786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'abf3f40d-6a8d-4904-a052-404d6171f187', 'volume_name': 'volume-abf3f40d-6a8d-4904-a052-404d6171f187', 'volume_size': 1, 'snapshot_id': '39602ed7-2b7b-4989-9cee-7ec2556a17af'}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60124d13-f672-4f90-bc8a-e839918af164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60124d13-f672-4f90-bc8a-e839918af164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05937c3d-8a42-4076-ace0-72de487d90be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:11 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Volume abf3f40d-6a8d-4904-a052-404d6171f187: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-abf3f40d-6a8d-4904-a052-404d6171f187', 'volume_size': 1, 'snapshot_id': '39602ed7-2b7b-4989-9cee-7ec2556a17af'} Apr 16 23:00:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:11 devstack sudo[86669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e Apr 16 23:00:11 devstack sudo[86669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:12 devstack sudo[86669]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e" returned: 0 in 0.596s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.607s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "cinder-quobyte-39602ed7-2b7b-4989-9cee-7ec2556a17af-abf3f40d-6a8d-4904-a052-404d6171f187" by "_create_volume_from_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6064872-db8d-45ca-a7b7-f2e4b497e25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad9741b-979c-4da4-8e79-9bf82ea7a5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-39602ed7-2b7b-4989-9cee-7ec2556a17af-abf3f40d-6a8d-4904-a052-404d6171f187" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Creating volume abf3f40d-6a8d-4904-a052-404d6171f187 from snapshot 39602ed7-2b7b-4989-9cee-7ec2556a17af {{(pid=81971) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "cinder-quobyte-abf3f40d-6a8d-4904-a052-404d6171f187" by "_copy_volume_from_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:00:12 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Volume volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e (f74dd9ca-92eb-40a0-ba0b-5f92176db90e): created successfully Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ad9741b-979c-4da4-8e79-9bf82ea7a5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Flow 'volume_create_manager' (2bd6b1f8-b74d-42a6-9960-c28710e16972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-abf3f40d-6a8d-4904-a052-404d6171f187" acquired by "_copy_volume_from_snapshot" :: waited 0.061s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] snapshot: 39602ed7-2b7b-4989-9cee-7ec2556a17af, volume: abf3f40d-6a8d-4904-a052-404d6171f187, {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 23:00:12 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-a1a8bb97-856a-46b9-9db5-b8e4ae4efed0 tempest-GroupsV314Test-880213091 None] Created volume successfully. Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82d27d1-7a00-41c4-9583-8edfe42bdc1d]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:00:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.39602ed7-2b7b-4989-9cee-7ec2556a17af {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:12 devstack sudo[86673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.39602ed7-2b7b-4989-9cee-7ec2556a17af Apr 16 23:00:12 devstack sudo[86673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:13 devstack sudo[86673]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.39602ed7-2b7b-4989-9cee-7ec2556a17af" returned: 0 in 0.612s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:00:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 23:00:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Creating direct copy from snapshot {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 23:00:13 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfdd8dc-62fc-4fd3-ab8b-63167f116de1]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:00:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:13 devstack sudo[86678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d Apr 16 23:00:13 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:13 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d" returned: 0 in 0.674s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:13 devstack cinder-volume[81971]: DEBUG cinder.utils [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Path /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-abf3f40d-6a8d-4904-a052-404d6171f187 not found in is_blk_device check {{(pid=81971) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 23:00:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-abf3f40d-6a8d-4904-a052-404d6171f187 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:13 devstack sudo[86683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-abf3f40d-6a8d-4904-a052-404d6171f187 Apr 16 23:00:13 devstack sudo[86683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:14 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:SELECT=157,cinder:UPDATE=146,cinder:INSERT=42,cinder:DELETE=11 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 23:00:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:17 devstack sudo[86683]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-abf3f40d-6a8d-4904-a052-404d6171f187" returned: 0 in 3.500s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:17 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d97503-ba67-4d26-af7c-e3834c8fbaf9]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:00:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:17 devstack sudo[86725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d Apr 16 23:00:17 devstack sudo[86725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:18 devstack sudo[86725]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d" returned: 0 in 0.770s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:18 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Image conversion details: src /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d, size 1024.00 MB, duration 3.50 sec, destination /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-abf3f40d-6a8d-4904-a052-404d6171f187 {{(pid=81971) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 23:00:18 devstack cinder-volume[81971]: INFO cinder.image.image_utils [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Converted 1024.00 MB image at 292.47 MB/s Apr 16 23:00:18 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-abf3f40d-6a8d-4904-a052-404d6171f187 is being set with open permissions: ugo+rw Apr 16 23:00:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-abf3f40d-6a8d-4904-a052-404d6171f187 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:18 devstack sudo[86731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-abf3f40d-6a8d-4904-a052-404d6171f187 Apr 16 23:00:18 devstack sudo[86731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:18 devstack sudo[86731]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-abf3f40d-6a8d-4904-a052-404d6171f187" returned: 0 in 0.597s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:18 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-abf3f40d-6a8d-4904-a052-404d6171f187" released by "_copy_volume_from_snapshot" :: held 6.294s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:00:18 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-39602ed7-2b7b-4989-9cee-7ec2556a17af-abf3f40d-6a8d-4904-a052-404d6171f187" released by "_create_volume_from_snapshot" :: held 6.371s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:00:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.414s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.400s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:18 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Cloning volume f74dd9ca-92eb-40a0-ba0b-5f92176db90e to volume 9f238933-35ba-46b5-b9d1-b73f73b3214d Apr 16 23:00:18 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Creating offline snapshot 2519e479-ab6d-462e-9f58-3971d7b08176 of volume f74dd9ca-92eb-40a0-ba0b-5f92176db90e {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:00:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05937c3d-8a42-4076-ace0-72de487d90be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abf3f40d-6a8d-4904-a052-404d6171f187', 'volume_size': 1, 'snapshot_id': '39602ed7-2b7b-4989-9cee-7ec2556a17af'}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baeb8baa-0d85-424e-b72e-cc0fe3a0d817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:18 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[15794229-ccf5-4dec-bbaf-290d72c61434]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:00:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:18 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Volume volume-abf3f40d-6a8d-4904-a052-404d6171f187 (abf3f40d-6a8d-4904-a052-404d6171f187): created successfully Apr 16 23:00:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baeb8baa-0d85-424e-b72e-cc0fe3a0d817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Flow 'volume_create_manager' (5efcc9e9-f700-44b5-9a2c-a2c015688afb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:00:18 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-97149d2e-f7f8-40d0-be27-5356c4776196 tempest-VolumesSnapshotTestJSON-1853747142 None] Created volume successfully. Apr 16 23:00:18 devstack sudo[86734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e Apr 16 23:00:18 devstack sudo[86734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:19 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-266be7a9-fe65-4d2e-a399-438f054f0021 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "cinder-abf3f40d-6a8d-4904-a052-404d6171f187-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:00:19 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-266be7a9-fe65-4d2e-a399-438f054f0021 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-abf3f40d-6a8d-4904-a052-404d6171f187-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:00:19 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-266be7a9-fe65-4d2e-a399-438f054f0021 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "cinder-quobyte-abf3f40d-6a8d-4904-a052-404d6171f187" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:00:19 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-266be7a9-fe65-4d2e-a399-438f054f0021 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-abf3f40d-6a8d-4904-a052-404d6171f187" acquired by "delete_volume" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:00:19 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa4bb8a-0080-4f55-8923-fe7c49307964]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:00:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-266be7a9-fe65-4d2e-a399-438f054f0021 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-abf3f40d-6a8d-4904-a052-404d6171f187 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:19 devstack sudo[86739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-abf3f40d-6a8d-4904-a052-404d6171f187 Apr 16 23:00:19 devstack sudo[86739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:19 devstack sudo[86734]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e" returned: 0 in 0.777s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.2519e479-ab6d-462e-9f58-3971d7b08176 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:19 devstack sudo[86741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.2519e479-ab6d-462e-9f58-3971d7b08176 1G Apr 16 23:00:19 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:20 devstack sudo[86739]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-266be7a9-fe65-4d2e-a399-438f054f0021 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-abf3f40d-6a8d-4904-a052-404d6171f187" returned: 0 in 0.652s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-266be7a9-fe65-4d2e-a399-438f054f0021 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-abf3f40d-6a8d-4904-a052-404d6171f187 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:20 devstack sudo[86749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-abf3f40d-6a8d-4904-a052-404d6171f187 Apr 16 23:00:20 devstack sudo[86749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:20 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.2519e479-ab6d-462e-9f58-3971d7b08176 1G" returned: 0 in 0.723s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.2519e479-ab6d-462e-9f58-3971d7b08176 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:20 devstack sudo[86751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.2519e479-ab6d-462e-9f58-3971d7b08176 Apr 16 23:00:20 devstack sudo[86751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:20 devstack sudo[86749]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-266be7a9-fe65-4d2e-a399-438f054f0021 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-abf3f40d-6a8d-4904-a052-404d6171f187" returned: 0 in 0.594s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:20 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-266be7a9-fe65-4d2e-a399-438f054f0021 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-abf3f40d-6a8d-4904-a052-404d6171f187" released by "delete_volume" :: held 1.277s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:00:20 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-266be7a9-fe65-4d2e-a399-438f054f0021 tempest-VolumesSnapshotTestJSON-1853747142 None] Created reservations ['1aece79c-c317-45ec-a5b2-a2be07444b06', 'b99b03b9-6a62-4e87-8900-2ec7f0d43960', '6a892558-bd2d-4e13-98af-ab301b387562', '6e45756d-016d-44a1-9a66-e6d0231e34d9'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:00:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-266be7a9-fe65-4d2e-a399-438f054f0021 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-266be7a9-fe65-4d2e-a399-438f054f0021 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:20 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-266be7a9-fe65-4d2e-a399-438f054f0021 tempest-VolumesSnapshotTestJSON-1853747142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:00:20 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-266be7a9-fe65-4d2e-a399-438f054f0021 tempest-VolumesSnapshotTestJSON-1853747142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:00:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-266be7a9-fe65-4d2e-a399-438f054f0021 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-266be7a9-fe65-4d2e-a399-438f054f0021 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:20 devstack sudo[86757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:00:20 devstack sudo[86757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:20 devstack sudo[86751]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.2519e479-ab6d-462e-9f58-3971d7b08176" returned: 0 in 0.615s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:20 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.2519e479-ab6d-462e-9f58-3971d7b08176 is being set with open permissions: ugo+rw: NotImplementedError Apr 16 23:00:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.2519e479-ab6d-462e-9f58-3971d7b08176 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:20 devstack sudo[86759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.2519e479-ab6d-462e-9f58-3971d7b08176 Apr 16 23:00:20 devstack sudo[86759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:21 devstack sudo[86759]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.2519e479-ab6d-462e-9f58-3971d7b08176" returned: 0 in 0.761s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-44aca32b-035a-4b84-adc6-4d6959e8da16 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "cinder-39602ed7-2b7b-4989-9cee-7ec2556a17af-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:00:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-44aca32b-035a-4b84-adc6-4d6959e8da16 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-39602ed7-2b7b-4989-9cee-7ec2556a17af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:00:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-44aca32b-035a-4b84-adc6-4d6959e8da16 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "cinder-quobyte-a0f52a8c-1f51-4992-b157-8a3e70e5108d" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:00:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-44aca32b-035a-4b84-adc6-4d6959e8da16 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-a0f52a8c-1f51-4992-b157-8a3e70e5108d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:00:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-44aca32b-035a-4b84-adc6-4d6959e8da16 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "cinder-quobyte-39602ed7-2b7b-4989-9cee-7ec2556a17af" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:00:21 devstack sudo[86763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.info Apr 16 23:00:21 devstack sudo[86763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-44aca32b-035a-4b84-adc6-4d6959e8da16 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-39602ed7-2b7b-4989-9cee-7ec2556a17af" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:00:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-44aca32b-035a-4b84-adc6-4d6959e8da16 tempest-VolumesSnapshotTestJSON-1853747142 None] Deleting offline snapshot 39602ed7-2b7b-4989-9cee-7ec2556a17af of volume a0f52a8c-1f51-4992-b157-8a3e70e5108d {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:00:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-44aca32b-035a-4b84-adc6-4d6959e8da16 tempest-VolumesSnapshotTestJSON-1853747142 None] snapshot_file for this snap is: volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.39602ed7-2b7b-4989-9cee-7ec2556a17af {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:00:21 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fd3347-bc59-4e72-8025-6d0bb2f00698]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:00:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-44aca32b-035a-4b84-adc6-4d6959e8da16 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.39602ed7-2b7b-4989-9cee-7ec2556a17af {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:21 devstack sudo[86757]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-266be7a9-fe65-4d2e-a399-438f054f0021 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 1.082s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:21 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-266be7a9-fe65-4d2e-a399-438f054f0021 tempest-VolumesSnapshotTestJSON-1853747142 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:00:21 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-266be7a9-fe65-4d2e-a399-438f054f0021 tempest-VolumesSnapshotTestJSON-1853747142 None] Deleted volume successfully. Apr 16 23:00:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-266be7a9-fe65-4d2e-a399-438f054f0021 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-abf3f40d-6a8d-4904-a052-404d6171f187-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:00:22 devstack sudo[86765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.39602ed7-2b7b-4989-9cee-7ec2556a17af Apr 16 23:00:22 devstack sudo[86765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:22 devstack sudo[86763]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.info" returned: 0 in 0.852s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:22 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.info is being set with open permissions: ugo+rw: NotImplementedError Apr 16 23:00:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:22 devstack sudo[86769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.info Apr 16 23:00:22 devstack sudo[86769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:23 devstack sudo[86765]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-44aca32b-035a-4b84-adc6-4d6959e8da16 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.39602ed7-2b7b-4989-9cee-7ec2556a17af" returned: 0 in 1.190s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-44aca32b-035a-4b84-adc6-4d6959e8da16 tempest-VolumesSnapshotTestJSON-1853747142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:00:23 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[88aa4657-f99a-48b3-914a-7d3fabf4b8ef]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:00:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-44aca32b-035a-4b84-adc6-4d6959e8da16 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:23 devstack sudo[86774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d Apr 16 23:00:23 devstack sudo[86774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:23 devstack sudo[86769]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.info" returned: 0 in 0.738s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:23 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Acquiring lock "cinder-quobyte-9f238933-35ba-46b5-b9d1-b73f73b3214d" by "_copy_volume_from_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:00:23 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Lock "cinder-quobyte-9f238933-35ba-46b5-b9d1-b73f73b3214d" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:00:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] snapshot: 2519e479-ab6d-462e-9f58-3971d7b08176, volume: 9f238933-35ba-46b5-b9d1-b73f73b3214d, {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 23:00:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:00:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:00:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:23 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[6314e9b2-1610-4dd9-a5f3-d6210445c743]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:00:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.2519e479-ab6d-462e-9f58-3971d7b08176 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:23 devstack sudo[86777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.2519e479-ab6d-462e-9f58-3971d7b08176 Apr 16 23:00:23 devstack sudo[86777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:23 devstack sudo[86774]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-44aca32b-035a-4b84-adc6-4d6959e8da16 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d" returned: 0 in 0.844s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-44aca32b-035a-4b84-adc6-4d6959e8da16 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.39602ed7-2b7b-4989-9cee-7ec2556a17af {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:23 devstack sudo[86786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.39602ed7-2b7b-4989-9cee-7ec2556a17af Apr 16 23:00:23 devstack sudo[86786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:24 devstack sudo[86777]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.2519e479-ab6d-462e-9f58-3971d7b08176" returned: 0 in 0.887s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:24 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:00:24 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 23:00:24 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Creating direct copy from snapshot {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 23:00:24 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e28c681-35b0-49d8-b21b-790207947d2e]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:00:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:24 devstack sudo[86792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e Apr 16 23:00:24 devstack sudo[86792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:24 devstack sudo[86786]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-44aca32b-035a-4b84-adc6-4d6959e8da16 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.39602ed7-2b7b-4989-9cee-7ec2556a17af" returned: 0 in 0.846s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-44aca32b-035a-4b84-adc6-4d6959e8da16 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.39602ed7-2b7b-4989-9cee-7ec2556a17af {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:24 devstack sudo[86801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.39602ed7-2b7b-4989-9cee-7ec2556a17af Apr 16 23:00:24 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:25 devstack sudo[86792]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e" returned: 0 in 0.803s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:25 devstack cinder-volume[81971]: DEBUG cinder.utils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Path /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f238933-35ba-46b5-b9d1-b73f73b3214d not found in is_blk_device check {{(pid=81971) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 23:00:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f238933-35ba-46b5-b9d1-b73f73b3214d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:25 devstack sudo[86806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f238933-35ba-46b5-b9d1-b73f73b3214d Apr 16 23:00:25 devstack sudo[86806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:25 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-44aca32b-035a-4b84-adc6-4d6959e8da16 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d.39602ed7-2b7b-4989-9cee-7ec2556a17af" returned: 0 in 0.772s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:25 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-44aca32b-035a-4b84-adc6-4d6959e8da16 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-39602ed7-2b7b-4989-9cee-7ec2556a17af" released by "_delete_snapshot" :: held 3.757s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:00:25 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-44aca32b-035a-4b84-adc6-4d6959e8da16 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-a0f52a8c-1f51-4992-b157-8a3e70e5108d" released by "delete_snapshot" :: held 3.785s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:00:25 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-44aca32b-035a-4b84-adc6-4d6959e8da16 tempest-VolumesSnapshotTestJSON-1853747142 None] Created reservations ['2f5bde20-c9f5-4be8-9745-69878c1c0539', 'ea685566-efdb-4476-9e5f-0b3c007a6009', 'fea027cd-f060-4e94-9432-42d13006efa4', '60b9163d-6d67-4c8f-af42-fdd0d405d8d1'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:00:25 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-44aca32b-035a-4b84-adc6-4d6959e8da16 tempest-VolumesSnapshotTestJSON-1853747142 None] Delete snapshot completed successfully. Apr 16 23:00:25 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-44aca32b-035a-4b84-adc6-4d6959e8da16 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-39602ed7-2b7b-4989-9cee-7ec2556a17af-delete_snapshot" released by "delete_snapshot" :: held 3.935s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:00:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f3e3147a-2dcb-4c7e-bf18-475f20e2610a tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "cinder-a0f52a8c-1f51-4992-b157-8a3e70e5108d-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:00:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f3e3147a-2dcb-4c7e-bf18-475f20e2610a tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-a0f52a8c-1f51-4992-b157-8a3e70e5108d-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:00:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f3e3147a-2dcb-4c7e-bf18-475f20e2610a tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "cinder-quobyte-a0f52a8c-1f51-4992-b157-8a3e70e5108d" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:00:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f3e3147a-2dcb-4c7e-bf18-475f20e2610a tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-a0f52a8c-1f51-4992-b157-8a3e70e5108d" acquired by "delete_volume" :: waited 0.025s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:00:26 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52b563a-a92c-4858-855f-259ba795efdf]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:00:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f3e3147a-2dcb-4c7e-bf18-475f20e2610a tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:27 devstack sudo[86822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d Apr 16 23:00:27 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:28 devstack sudo[86806]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f238933-35ba-46b5-b9d1-b73f73b3214d" returned: 0 in 3.351s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:28 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[3304d370-b78a-4fa6-a1e4-f90684ace608]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:00:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:28 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f3e3147a-2dcb-4c7e-bf18-475f20e2610a tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d" returned: 0 in 1.755s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f3e3147a-2dcb-4c7e-bf18-475f20e2610a tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:28 devstack sudo[86828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e Apr 16 23:00:28 devstack sudo[86828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:28 devstack sudo[86829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d Apr 16 23:00:28 devstack sudo[86829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:29 devstack sudo[86829]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f3e3147a-2dcb-4c7e-bf18-475f20e2610a tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a0f52a8c-1f51-4992-b157-8a3e70e5108d" returned: 0 in 0.727s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:29 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f3e3147a-2dcb-4c7e-bf18-475f20e2610a tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-a0f52a8c-1f51-4992-b157-8a3e70e5108d" released by "delete_volume" :: held 2.581s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:00:29 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-f3e3147a-2dcb-4c7e-bf18-475f20e2610a tempest-VolumesSnapshotTestJSON-1853747142 None] Created reservations ['f82ab4dd-4354-4630-8ce9-25d13bcb1f2a', '8a540533-c4e2-4f1a-bd0a-0ad6c8bc27fd', '590d0a52-18e9-4eee-823a-80e6b12b735d', '3b7fa6c6-4aef-44f2-80c3-a271c29daa9e'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:00:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f3e3147a-2dcb-4c7e-bf18-475f20e2610a tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f3e3147a-2dcb-4c7e-bf18-475f20e2610a tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:29 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-f3e3147a-2dcb-4c7e-bf18-475f20e2610a tempest-VolumesSnapshotTestJSON-1853747142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:00:29 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-f3e3147a-2dcb-4c7e-bf18-475f20e2610a tempest-VolumesSnapshotTestJSON-1853747142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:00:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f3e3147a-2dcb-4c7e-bf18-475f20e2610a tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f3e3147a-2dcb-4c7e-bf18-475f20e2610a tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:29 devstack sudo[86835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:00:29 devstack sudo[86835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:29 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3bb06511-b3e4-48b9-a437-4b99d2eefae2 tempest-VolumesNegativeTest-848299870 None] Acquiring lock "cinder-bc7828a8-4b56-45e0-ba74-160752e109c9-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:00:29 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3bb06511-b3e4-48b9-a437-4b99d2eefae2 tempest-VolumesNegativeTest-848299870 None] Lock "cinder-bc7828a8-4b56-45e0-ba74-160752e109c9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:00:29 devstack sudo[86828]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e" returned: 0 in 1.247s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:29 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Image conversion details: src /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e, size 1024.00 MB, duration 3.35 sec, destination /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f238933-35ba-46b5-b9d1-b73f73b3214d {{(pid=81971) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 23:00:29 devstack cinder-volume[81971]: INFO cinder.image.image_utils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Converted 1024.00 MB image at 305.47 MB/s Apr 16 23:00:29 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f238933-35ba-46b5-b9d1-b73f73b3214d is being set with open permissions: ugo+rw: NotImplementedError Apr 16 23:00:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f238933-35ba-46b5-b9d1-b73f73b3214d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:29 devstack sudo[86838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f238933-35ba-46b5-b9d1-b73f73b3214d Apr 16 23:00:29 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:29 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3bb06511-b3e4-48b9-a437-4b99d2eefae2 tempest-VolumesNegativeTest-848299870 None] Acquiring lock "cinder-quobyte-bc7828a8-4b56-45e0-ba74-160752e109c9" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:00:29 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3bb06511-b3e4-48b9-a437-4b99d2eefae2 tempest-VolumesNegativeTest-848299870 None] Lock "cinder-quobyte-bc7828a8-4b56-45e0-ba74-160752e109c9" acquired by "delete_volume" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:00:29 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3f5672-afe3-45fd-bbbf-886d6ea35ae2]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:00:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bb06511-b3e4-48b9-a437-4b99d2eefae2 tempest-VolumesNegativeTest-848299870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bc7828a8-4b56-45e0-ba74-160752e109c9 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:30 devstack sudo[86840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bc7828a8-4b56-45e0-ba74-160752e109c9 Apr 16 23:00:30 devstack sudo[86840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:30 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f1eb80b7-f6aa-44f8-a3d4-54283b8e8507 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "cinder-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:00:30 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f1eb80b7-f6aa-44f8-a3d4-54283b8e8507 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:00:30 devstack sudo[86835]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:30 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f1eb80b7-f6aa-44f8-a3d4-54283b8e8507 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "cinder-quobyte-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:00:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f3e3147a-2dcb-4c7e-bf18-475f20e2610a tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.821s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:30 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-f3e3147a-2dcb-4c7e-bf18-475f20e2610a tempest-VolumesSnapshotTestJSON-1853747142 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:00:30 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-f3e3147a-2dcb-4c7e-bf18-475f20e2610a tempest-VolumesSnapshotTestJSON-1853747142 None] Deleted volume successfully. Apr 16 23:00:30 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f1eb80b7-f6aa-44f8-a3d4-54283b8e8507 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8" acquired by "delete_volume" :: waited 0.023s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:00:30 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f3e3147a-2dcb-4c7e-bf18-475f20e2610a tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-a0f52a8c-1f51-4992-b157-8a3e70e5108d-delete_volume" released by "delete_volume" :: held 3.805s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:00:30 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f688ba-5934-4613-bb2f-6421b39d5454]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:00:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f1eb80b7-f6aa-44f8-a3d4-54283b8e8507 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:30 devstack sudo[86844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8 Apr 16 23:00:30 devstack sudo[86844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:30 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f238933-35ba-46b5-b9d1-b73f73b3214d" returned: 0 in 0.700s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:30 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Lock "cinder-quobyte-9f238933-35ba-46b5-b9d1-b73f73b3214d" released by "_copy_volume_from_snapshot" :: held 7.069s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:00:30 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Acquiring lock "cinder-quobyte-2519e479-ab6d-462e-9f58-3971d7b08176" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:00:30 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Lock "cinder-quobyte-2519e479-ab6d-462e-9f58-3971d7b08176" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:00:30 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Deleting offline snapshot 2519e479-ab6d-462e-9f58-3971d7b08176 of volume f74dd9ca-92eb-40a0-ba0b-5f92176db90e {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:00:30 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] snapshot_file for this snap is: volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.2519e479-ab6d-462e-9f58-3971d7b08176 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:00:30 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c342d74-1a06-449d-a5f9-f67e63fc7983]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:00:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.2519e479-ab6d-462e-9f58-3971d7b08176 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:30 devstack sudo[86847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.2519e479-ab6d-462e-9f58-3971d7b08176 Apr 16 23:00:30 devstack sudo[86847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:30 devstack sudo[86840]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bb06511-b3e4-48b9-a437-4b99d2eefae2 tempest-VolumesNegativeTest-848299870 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bc7828a8-4b56-45e0-ba74-160752e109c9" returned: 0 in 1.051s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bb06511-b3e4-48b9-a437-4b99d2eefae2 tempest-VolumesNegativeTest-848299870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bc7828a8-4b56-45e0-ba74-160752e109c9 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:30 devstack sudo[86861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bc7828a8-4b56-45e0-ba74-160752e109c9 Apr 16 23:00:30 devstack sudo[86861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:31 devstack sudo[86844]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f1eb80b7-f6aa-44f8-a3d4-54283b8e8507 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8" returned: 0 in 0.931s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f1eb80b7-f6aa-44f8-a3d4-54283b8e8507 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:31 devstack sudo[86875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8 Apr 16 23:00:31 devstack sudo[86875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:31 devstack sudo[86847]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.2519e479-ab6d-462e-9f58-3971d7b08176" returned: 0 in 0.916s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:31 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:00:31 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[5015ad50-b0d4-471c-8f3d-9391eb390752]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:00:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:31 devstack sudo[86861]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bb06511-b3e4-48b9-a437-4b99d2eefae2 tempest-VolumesNegativeTest-848299870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bc7828a8-4b56-45e0-ba74-160752e109c9" returned: 0 in 0.670s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:31 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3bb06511-b3e4-48b9-a437-4b99d2eefae2 tempest-VolumesNegativeTest-848299870 None] Lock "cinder-quobyte-bc7828a8-4b56-45e0-ba74-160752e109c9" released by "delete_volume" :: held 1.768s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:00:31 devstack sudo[86878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e Apr 16 23:00:31 devstack sudo[86878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:31 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-3bb06511-b3e4-48b9-a437-4b99d2eefae2 tempest-VolumesNegativeTest-848299870 None] Created reservations ['31744890-3663-4d1d-bfd3-2675364f0a88', '915f603c-97bb-4ce2-b095-d58cf813931a', '029d7c11-8ecb-453c-a352-3a56a777e4fc', 'a1d6fad9-8b03-4b40-b3fb-3ef33372cb60'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:00:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3bb06511-b3e4-48b9-a437-4b99d2eefae2 tempest-VolumesNegativeTest-848299870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3bb06511-b3e4-48b9-a437-4b99d2eefae2 tempest-VolumesNegativeTest-848299870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:31 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3bb06511-b3e4-48b9-a437-4b99d2eefae2 tempest-VolumesNegativeTest-848299870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:00:31 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3bb06511-b3e4-48b9-a437-4b99d2eefae2 tempest-VolumesNegativeTest-848299870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:00:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3bb06511-b3e4-48b9-a437-4b99d2eefae2 tempest-VolumesNegativeTest-848299870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bb06511-b3e4-48b9-a437-4b99d2eefae2 tempest-VolumesNegativeTest-848299870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:31 devstack sudo[86881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:00:31 devstack sudo[86881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:31 devstack sudo[86875]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f1eb80b7-f6aa-44f8-a3d4-54283b8e8507 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8" returned: 0 in 0.615s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:31 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f1eb80b7-f6aa-44f8-a3d4-54283b8e8507 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-quobyte-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8" released by "delete_volume" :: held 1.598s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:00:31 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-f1eb80b7-f6aa-44f8-a3d4-54283b8e8507 tempest-VolumesSnapshotTestJSON-1853747142 None] Created reservations ['b32c4905-a93b-40af-917d-a51572ebf7fb', 'ca497c54-8aad-4c22-a379-8fee09ac1f57', 'b918b0b3-0def-4bfa-8163-8b7f83bc8f3a', '0b7c147e-10cd-4c31-a150-64f97c7f1be3'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:00:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f1eb80b7-f6aa-44f8-a3d4-54283b8e8507 tempest-VolumesSnapshotTestJSON-1853747142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f1eb80b7-f6aa-44f8-a3d4-54283b8e8507 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:32 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-f1eb80b7-f6aa-44f8-a3d4-54283b8e8507 tempest-VolumesSnapshotTestJSON-1853747142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:00:32 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-f1eb80b7-f6aa-44f8-a3d4-54283b8e8507 tempest-VolumesSnapshotTestJSON-1853747142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:00:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f1eb80b7-f6aa-44f8-a3d4-54283b8e8507 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f1eb80b7-f6aa-44f8-a3d4-54283b8e8507 tempest-VolumesSnapshotTestJSON-1853747142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:32 devstack sudo[86884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:00:32 devstack sudo[86884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:32 devstack sudo[86878]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e" returned: 0 in 0.859s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.2519e479-ab6d-462e-9f58-3971d7b08176 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:32 devstack sudo[86889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.2519e479-ab6d-462e-9f58-3971d7b08176 Apr 16 23:00:32 devstack sudo[86889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:32 devstack sudo[86881]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bb06511-b3e4-48b9-a437-4b99d2eefae2 tempest-VolumesNegativeTest-848299870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.722s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:32 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-3bb06511-b3e4-48b9-a437-4b99d2eefae2 tempest-VolumesNegativeTest-848299870 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:00:32 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-3bb06511-b3e4-48b9-a437-4b99d2eefae2 tempest-VolumesNegativeTest-848299870 None] Deleted volume successfully. Apr 16 23:00:32 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3bb06511-b3e4-48b9-a437-4b99d2eefae2 tempest-VolumesNegativeTest-848299870 None] Lock "cinder-bc7828a8-4b56-45e0-ba74-160752e109c9-delete_volume" released by "delete_volume" :: held 2.839s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:00:32 devstack sudo[86884]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f1eb80b7-f6aa-44f8-a3d4-54283b8e8507 tempest-VolumesSnapshotTestJSON-1853747142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.702s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:32 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-f1eb80b7-f6aa-44f8-a3d4-54283b8e8507 tempest-VolumesSnapshotTestJSON-1853747142 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:00:32 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-f1eb80b7-f6aa-44f8-a3d4-54283b8e8507 tempest-VolumesSnapshotTestJSON-1853747142 None] Deleted volume successfully. Apr 16 23:00:32 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f1eb80b7-f6aa-44f8-a3d4-54283b8e8507 tempest-VolumesSnapshotTestJSON-1853747142 None] Lock "cinder-f9fdb7bf-bea3-406a-9e11-1ae727a9e0a8-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:00:33 devstack sudo[86889]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.2519e479-ab6d-462e-9f58-3971d7b08176" returned: 0 in 0.861s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.2519e479-ab6d-462e-9f58-3971d7b08176 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:33 devstack sudo[86910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.2519e479-ab6d-462e-9f58-3971d7b08176 Apr 16 23:00:33 devstack sudo[86910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:33 devstack sudo[86910]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e.2519e479-ab6d-462e-9f58-3971d7b08176" returned: 0 in 0.580s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:33 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Lock "cinder-quobyte-2519e479-ab6d-462e-9f58-3971d7b08176" released by "_delete_snapshot" :: held 3.293s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:00:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.021s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:33 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-6d91cfcc-9c9e-4f82-b553-88a23d446e0f tempest-GroupsV314Test-880213091 None] Create group from source-group-52414a19-b6df-473f-87aa-5c28333a4a19 completed successfully. Apr 16 23:00:34 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ad7f6bd0-3e53-428b-af7b-9104343a0c49 tempest-GroupsV314Test-880213091 None] Acquiring lock "cinder-quobyte-9f238933-35ba-46b5-b9d1-b73f73b3214d" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:00:34 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ad7f6bd0-3e53-428b-af7b-9104343a0c49 tempest-GroupsV314Test-880213091 None] Lock "cinder-quobyte-9f238933-35ba-46b5-b9d1-b73f73b3214d" acquired by "delete_volume" :: waited 0.024s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:00:34 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[b673e7e5-c1bb-49e1-a401-c9f528e6da05]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:00:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ad7f6bd0-3e53-428b-af7b-9104343a0c49 tempest-GroupsV314Test-880213091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f238933-35ba-46b5-b9d1-b73f73b3214d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:34 devstack sudo[86916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f238933-35ba-46b5-b9d1-b73f73b3214d Apr 16 23:00:34 devstack sudo[86916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:35 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:00:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Flow 'volume_create_manager' (111545e8-5679-4944-96cd-9b1669dad193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:00:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41c1a6e-dd9e-40e1-a012-6610fe58f2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a41c1a6e-dd9e-40e1-a012-6610fe58f2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1814778473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11745c7e-4509-45b4-b845-96c95137ecda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b44879303f54c66b6a7c3fd314992b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:00:35Z,use_quota=True,user_id='5d5cfb2bb6194ff387371b5601352558',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f163a3db-83d6-4c74-bc11-036b461a429f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f163a3db-83d6-4c74-bc11-036b461a429f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47182c1b-bf0a-4af7-ae4e-28e283254c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47182c1b-bf0a-4af7-ae4e-28e283254c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11745c7e-4509-45b4-b845-96c95137ecda', 'volume_name': 'volume-11745c7e-4509-45b4-b845-96c95137ecda', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68d970d-2402-45dd-8da5-184fa0ea48cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68d970d-2402-45dd-8da5-184fa0ea48cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be43ca4-848d-432e-b71f-2a3c0a481357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:35 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Volume 11745c7e-4509-45b4-b845-96c95137ecda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11745c7e-4509-45b4-b845-96c95137ecda', 'volume_size': 1} Apr 16 23:00:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1814778473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11745c7e-4509-45b4-b845-96c95137ecda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b44879303f54c66b6a7c3fd314992b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:00:35Z,use_quota=True,user_id='5d5cfb2bb6194ff387371b5601352558',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:00:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Creating volume 11745c7e-4509-45b4-b845-96c95137ecda {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:00:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:00:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:00:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:00:35 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:00:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:35 devstack sudo[86921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda 1073741824 Apr 16 23:00:35 devstack sudo[86921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:35 devstack sudo[86916]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ad7f6bd0-3e53-428b-af7b-9104343a0c49 tempest-GroupsV314Test-880213091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f238933-35ba-46b5-b9d1-b73f73b3214d" returned: 0 in 0.651s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ad7f6bd0-3e53-428b-af7b-9104343a0c49 tempest-GroupsV314Test-880213091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f238933-35ba-46b5-b9d1-b73f73b3214d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:35 devstack sudo[86926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f238933-35ba-46b5-b9d1-b73f73b3214d Apr 16 23:00:35 devstack sudo[86926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:35 devstack sudo[86921]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda 1073741824" returned: 0 in 0.835s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:36 devstack sudo[86931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda Apr 16 23:00:36 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:36 devstack sudo[86926]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ad7f6bd0-3e53-428b-af7b-9104343a0c49 tempest-GroupsV314Test-880213091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f238933-35ba-46b5-b9d1-b73f73b3214d" returned: 0 in 0.987s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:36 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ad7f6bd0-3e53-428b-af7b-9104343a0c49 tempest-GroupsV314Test-880213091 None] Lock "cinder-quobyte-9f238933-35ba-46b5-b9d1-b73f73b3214d" released by "delete_volume" :: held 1.680s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:00:36 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-ad7f6bd0-3e53-428b-af7b-9104343a0c49 tempest-GroupsV314Test-880213091 None] Created reservations ['d2bcdb23-08fa-4d77-88da-5f8242551736'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:00:36 devstack cinder-volume[81971]: WARNING cinder.quota [None req-ad7f6bd0-3e53-428b-af7b-9104343a0c49 tempest-GroupsV314Test-880213091 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-786519975 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-786519975, it is now deprecated. Please use the default quota class for default quota. Apr 16 23:00:36 devstack cinder-volume[81971]: WARNING cinder.quota [None req-ad7f6bd0-3e53-428b-af7b-9104343a0c49 tempest-GroupsV314Test-880213091 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-786519975 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-786519975, it is now deprecated. Please use the default quota class for default quota. Apr 16 23:00:36 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-ad7f6bd0-3e53-428b-af7b-9104343a0c49 tempest-GroupsV314Test-880213091 None] Created reservations ['d7cc8da8-27e8-44cf-9e80-10412acb2607', '4fe8b0de-13b4-428c-999b-aeeec514901d', '30dc7f4f-e5ac-43b7-9bc8-eb1731ba476a', '6f1b741a-a151-4763-981e-ee3234e69031'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:00:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ad7f6bd0-3e53-428b-af7b-9104343a0c49 tempest-GroupsV314Test-880213091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ad7f6bd0-3e53-428b-af7b-9104343a0c49 tempest-GroupsV314Test-880213091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ad7f6bd0-3e53-428b-af7b-9104343a0c49 tempest-GroupsV314Test-880213091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:00:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ad7f6bd0-3e53-428b-af7b-9104343a0c49 tempest-GroupsV314Test-880213091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:00:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ad7f6bd0-3e53-428b-af7b-9104343a0c49 tempest-GroupsV314Test-880213091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ad7f6bd0-3e53-428b-af7b-9104343a0c49 tempest-GroupsV314Test-880213091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:36 devstack sudo[86960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:00:36 devstack sudo[86960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:36 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda" returned: 0 in 0.843s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:00:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2be43ca4-848d-432e-b71f-2a3c0a481357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11745c7e-4509-45b4-b845-96c95137ecda', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120d76c4-dcef-476d-9d27-ed2050b63436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:36 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Volume volume-11745c7e-4509-45b4-b845-96c95137ecda (11745c7e-4509-45b4-b845-96c95137ecda): created successfully Apr 16 23:00:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120d76c4-dcef-476d-9d27-ed2050b63436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Flow 'volume_create_manager' (111545e8-5679-4944-96cd-9b1669dad193) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:00:36 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-18957102-9fb3-4ecf-b895-030ffef14182 tempest-VolumesSnapshotListTestJSON-1064752421 None] Created volume successfully. Apr 16 23:00:37 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-0f1c3db0-4426-4914-a687-291380262bc0 tempest-GroupsV314Test-880213091 None] Acquiring lock "cinder-quobyte-f74dd9ca-92eb-40a0-ba0b-5f92176db90e" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:00:37 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-0f1c3db0-4426-4914-a687-291380262bc0 tempest-GroupsV314Test-880213091 None] Lock "cinder-quobyte-f74dd9ca-92eb-40a0-ba0b-5f92176db90e" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:00:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-05943da0-960d-446a-aaf2-1d764f2400b9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-05943da0-960d-446a-aaf2-1d764f2400b9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:37 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f79c86-6f5e-4a47-986c-2e60ae522834]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:00:37 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-05943da0-960d-446a-aaf2-1d764f2400b9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Creating offline snapshot 9c01298d-5b2c-4fbf-af99-f70b5f0ff317 of volume 11745c7e-4509-45b4-b845-96c95137ecda {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:00:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0f1c3db0-4426-4914-a687-291380262bc0 tempest-GroupsV314Test-880213091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:37 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c607c5-5aa3-41f6-9a81-56ac92855ed0]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:00:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05943da0-960d-446a-aaf2-1d764f2400b9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:37 devstack sudo[86967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e Apr 16 23:00:37 devstack sudo[86967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:37 devstack sudo[86969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda Apr 16 23:00:37 devstack sudo[86969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:37 devstack sudo[86960]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ad7f6bd0-3e53-428b-af7b-9104343a0c49 tempest-GroupsV314Test-880213091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 1.213s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:37 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-ad7f6bd0-3e53-428b-af7b-9104343a0c49 tempest-GroupsV314Test-880213091 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:00:37 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-ad7f6bd0-3e53-428b-af7b-9104343a0c49 tempest-GroupsV314Test-880213091 None] Delete group completed successfully. Apr 16 23:00:38 devstack sudo[86969]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05943da0-960d-446a-aaf2-1d764f2400b9 tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda" returned: 0 in 0.865s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05943da0-960d-446a-aaf2-1d764f2400b9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:38 devstack sudo[86980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317 1G Apr 16 23:00:38 devstack sudo[86980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:38 devstack sudo[86967]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0f1c3db0-4426-4914-a687-291380262bc0 tempest-GroupsV314Test-880213091 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e" returned: 0 in 0.940s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0f1c3db0-4426-4914-a687-291380262bc0 tempest-GroupsV314Test-880213091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:38 devstack sudo[86982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e Apr 16 23:00:38 devstack sudo[86982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:39 devstack sudo[86982]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0f1c3db0-4426-4914-a687-291380262bc0 tempest-GroupsV314Test-880213091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f74dd9ca-92eb-40a0-ba0b-5f92176db90e" returned: 0 in 1.204s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:39 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-0f1c3db0-4426-4914-a687-291380262bc0 tempest-GroupsV314Test-880213091 None] Lock "cinder-quobyte-f74dd9ca-92eb-40a0-ba0b-5f92176db90e" released by "delete_volume" :: held 2.295s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:00:39 devstack sudo[86980]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05943da0-960d-446a-aaf2-1d764f2400b9 tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317 1G" returned: 0 in 1.317s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05943da0-960d-446a-aaf2-1d764f2400b9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11745c7e-4509-45b4-b845-96c95137ecda -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:39 devstack sudo[87012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11745c7e-4509-45b4-b845-96c95137ecda -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317 Apr 16 23:00:39 devstack sudo[87012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:39 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-0f1c3db0-4426-4914-a687-291380262bc0 tempest-GroupsV314Test-880213091 None] Created reservations ['b445e5d6-81cb-43ca-948e-68d996f98a3c'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:00:40 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-0f1c3db0-4426-4914-a687-291380262bc0 tempest-GroupsV314Test-880213091 None] Created reservations ['9f5ce582-2da0-4db7-88cf-d82421f87fc2', '7288067d-6ff1-4797-a9e2-986bf70f7505', 'b272e327-ffe0-4851-b0f1-f3b998bb5983', '1d7338e2-24ce-463e-85d3-ee457b762b64'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:00:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0f1c3db0-4426-4914-a687-291380262bc0 tempest-GroupsV314Test-880213091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0f1c3db0-4426-4914-a687-291380262bc0 tempest-GroupsV314Test-880213091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-0f1c3db0-4426-4914-a687-291380262bc0 tempest-GroupsV314Test-880213091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:00:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-0f1c3db0-4426-4914-a687-291380262bc0 tempest-GroupsV314Test-880213091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:00:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0f1c3db0-4426-4914-a687-291380262bc0 tempest-GroupsV314Test-880213091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0f1c3db0-4426-4914-a687-291380262bc0 tempest-GroupsV314Test-880213091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:40 devstack sudo[87015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:00:40 devstack sudo[87015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:40 devstack sudo[87012]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05943da0-960d-446a-aaf2-1d764f2400b9 tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11745c7e-4509-45b4-b845-96c95137ecda -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317" returned: 0 in 0.909s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:40 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-05943da0-960d-446a-aaf2-1d764f2400b9 tempest-VolumesSnapshotListTestJSON-1064752421 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317 is being set with open permissions: ugo+rw Apr 16 23:00:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05943da0-960d-446a-aaf2-1d764f2400b9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:40 devstack sudo[87020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317 Apr 16 23:00:40 devstack sudo[87020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:40 devstack sudo[87015]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0f1c3db0-4426-4914-a687-291380262bc0 tempest-GroupsV314Test-880213091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.722s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:40 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-0f1c3db0-4426-4914-a687-291380262bc0 tempest-GroupsV314Test-880213091 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:00:40 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-0f1c3db0-4426-4914-a687-291380262bc0 tempest-GroupsV314Test-880213091 None] Delete group completed successfully. Apr 16 23:00:41 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:00:41 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Flow 'volume_create_manager' (0330ab06-072e-4a30-addb-755f1e4096b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:00:41 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a399e97-07da-41e9-add3-c3329a8a356d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:41 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a399e97-07da-41e9-add3-c3329a8a356d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1263593818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c25ed0-c4cb-4632-977a-40fa27c47651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5bfeaf5cf624e3785ff524cc8345045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:00:41Z,use_quota=True,user_id='7e3475761c3e4374b4d92a7242f67fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:41 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212935c9-aa9f-424d-979b-943b5250d55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:41 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (212935c9-aa9f-424d-979b-943b5250d55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:41 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068632f3-0090-47a2-a2e9-f88ce12e966f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:41 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068632f3-0090-47a2-a2e9-f88ce12e966f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87c25ed0-c4cb-4632-977a-40fa27c47651', 'volume_name': 'volume-87c25ed0-c4cb-4632-977a-40fa27c47651', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:41 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b26470d-cf56-4cbc-9bc2-16a7c0e90576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:41 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b26470d-cf56-4cbc-9bc2-16a7c0e90576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:41 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7a06f9-772f-48e0-8d16-0ea1acdc4d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:41 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Volume 87c25ed0-c4cb-4632-977a-40fa27c47651: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87c25ed0-c4cb-4632-977a-40fa27c47651', 'volume_size': 1} Apr 16 23:00:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:41 devstack sudo[87020]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05943da0-960d-446a-aaf2-1d764f2400b9 tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317" returned: 0 in 0.650s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05943da0-960d-446a-aaf2-1d764f2400b9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:41 devstack sudo[87024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.info Apr 16 23:00:41 devstack sudo[87024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:42 devstack sudo[87024]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05943da0-960d-446a-aaf2-1d764f2400b9 tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.info" returned: 0 in 0.842s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:42 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-05943da0-960d-446a-aaf2-1d764f2400b9 tempest-VolumesSnapshotListTestJSON-1064752421 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.info is being set with open permissions: ugo+rw Apr 16 23:00:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05943da0-960d-446a-aaf2-1d764f2400b9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:42 devstack sudo[87029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.info Apr 16 23:00:42 devstack sudo[87029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:42 devstack sudo[87029]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05943da0-960d-446a-aaf2-1d764f2400b9 tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.info" returned: 0 in 0.644s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-05943da0-960d-446a-aaf2-1d764f2400b9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.337s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.574s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:42 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:00:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1263593818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c25ed0-c4cb-4632-977a-40fa27c47651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5bfeaf5cf624e3785ff524cc8345045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:00:41Z,use_quota=True,user_id='7e3475761c3e4374b4d92a7242f67fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:00:42 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Creating volume 87c25ed0-c4cb-4632-977a-40fa27c47651 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:00:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:42 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:00:42 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:00:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:42 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:00:42 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:00:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-87c25ed0-c4cb-4632-977a-40fa27c47651 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:42 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-05943da0-960d-446a-aaf2-1d764f2400b9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Create snapshot completed successfully Apr 16 23:00:43 devstack sudo[87032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-87c25ed0-c4cb-4632-977a-40fa27c47651 1073741824 Apr 16 23:00:43 devstack sudo[87032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:44 devstack sudo[87032]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-87c25ed0-c4cb-4632-977a-40fa27c47651 1073741824" returned: 0 in 1.320s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-87c25ed0-c4cb-4632-977a-40fa27c47651 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:44 devstack sudo[87038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-87c25ed0-c4cb-4632-977a-40fa27c47651 Apr 16 23:00:44 devstack sudo[87038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-cc28f519-f74d-4cfa-8aa5-7416203a7064 tempest-VolumesSnapshotListTestJSON-1064752421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:45 devstack sudo[87038]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-87c25ed0-c4cb-4632-977a-40fa27c47651" returned: 0 in 0.808s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:45 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] <== create_volume: return (2183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:00:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.187s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-cc28f519-f74d-4cfa-8aa5-7416203a7064 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.633s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:45 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-cc28f519-f74d-4cfa-8aa5-7416203a7064 tempest-VolumesSnapshotListTestJSON-1064752421 None] Creating offline snapshot 01eedae1-b945-459b-b78c-0a718b471c3e of volume 11745c7e-4509-45b4-b845-96c95137ecda {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:00:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7a06f9-772f-48e0-8d16-0ea1acdc4d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87c25ed0-c4cb-4632-977a-40fa27c47651', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14d9cfb2-e91a-4588-bb1f-ae59f6cf638a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:45 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[346edf73-072f-4767-a452-7cd6fd2afe2a]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:00:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cc28f519-f74d-4cfa-8aa5-7416203a7064 tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:45 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Volume volume-87c25ed0-c4cb-4632-977a-40fa27c47651 (87c25ed0-c4cb-4632-977a-40fa27c47651): created successfully Apr 16 23:00:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14d9cfb2-e91a-4588-bb1f-ae59f6cf638a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Flow 'volume_create_manager' (0330ab06-072e-4a30-addb-755f1e4096b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:00:45 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-69fc6c60-3559-400d-b064-6a17bf7055ff tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Created volume successfully. Apr 16 23:00:45 devstack sudo[87041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317 Apr 16 23:00:45 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Flow 'volume_create_manager' (fd007409-04b4-4941-b7b4-207cac7a114c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:00:46 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fee51c-065a-4963-9da2-ec6bf23415e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cc28f519-f74d-4cfa-8aa5-7416203a7064 tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317" returned: 0 in 1.412s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-cc28f519-f74d-4cfa-8aa5-7416203a7064 tempest-VolumesSnapshotListTestJSON-1064752421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11745c7e-4509-45b4-b845-96c95137ecda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cc28f519-f74d-4cfa-8aa5-7416203a7064 tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fee51c-065a-4963-9da2-ec6bf23415e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1138919840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4961757-ff3f-457b-87cc-993e2362d4cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5bfeaf5cf624e3785ff524cc8345045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:00:46Z,use_quota=True,user_id='7e3475761c3e4374b4d92a7242f67fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0134c501-afe6-4e78-9b94-f076f7ac9e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0134c501-afe6-4e78-9b94-f076f7ac9e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e65a1f-d09b-45d8-a063-4ef646b78a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e65a1f-d09b-45d8-a063-4ef646b78a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4961757-ff3f-457b-87cc-993e2362d4cc', 'volume_name': 'volume-d4961757-ff3f-457b-87cc-993e2362d4cc', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760dcecb-730e-42ec-a694-d431708787de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760dcecb-730e-42ec-a694-d431708787de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb511c8-76b2-45dc-8c48-e00d8569b4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:46 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Volume d4961757-ff3f-457b-87cc-993e2362d4cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4961757-ff3f-457b-87cc-993e2362d4cc', 'volume_size': 1} Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:46 devstack sudo[87052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e 1G Apr 16 23:00:46 devstack sudo[87052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Flow 'volume_create_manager' (07b4960a-bedc-49ed-ad96-b4f648dd3a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f5ff525-7346-46d1-a72e-b218dfe3ddea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f5ff525-7346-46d1-a72e-b218dfe3ddea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2095339286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c45792-7328-45d2-a0f0-a861d92a805a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5bfeaf5cf624e3785ff524cc8345045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:00:47Z,use_quota=True,user_id='7e3475761c3e4374b4d92a7242f67fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92812a11-9cf0-4e34-afc9-d1579c47457f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92812a11-9cf0-4e34-afc9-d1579c47457f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8270f0ec-d4d5-4ad6-a10f-b4e940286d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8270f0ec-d4d5-4ad6-a10f-b4e940286d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7c45792-7328-45d2-a0f0-a861d92a805a', 'volume_name': 'volume-a7c45792-7328-45d2-a0f0-a861d92a805a', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e067dac-b1cd-4d82-b4d1-86c576e502ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e067dac-b1cd-4d82-b4d1-86c576e502ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255ed564-8c58-41e1-9711-018b412d381c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:46 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Volume a7c45792-7328-45d2-a0f0-a861d92a805a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7c45792-7328-45d2-a0f0-a861d92a805a', 'volume_size': 1} Apr 16 23:00:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:47 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:00:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Flow 'volume_create_manager' (b5b0c732-9712-4fb8-a21a-15632df74a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:00:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a5811e-d4c0-479c-af1e-86df8fa43773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a5811e-d4c0-479c-af1e-86df8fa43773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1575216629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35a1a408-a5ea-4c40-a59e-247501880bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5bfeaf5cf624e3785ff524cc8345045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:00:47Z,use_quota=True,user_id='7e3475761c3e4374b4d92a7242f67fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeccca46-107f-471e-bd05-85f4aa83fe34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aeccca46-107f-471e-bd05-85f4aa83fe34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a6e90b-0c71-4852-aee0-687174c1d5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52a6e90b-0c71-4852-aee0-687174c1d5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35a1a408-a5ea-4c40-a59e-247501880bee', 'volume_name': 'volume-35a1a408-a5ea-4c40-a59e-247501880bee', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a377ec1-4fea-420f-9ecb-b8c6536608c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a377ec1-4fea-420f-9ecb-b8c6536608c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2255093d-dc7c-4e1e-b155-a2f4e8805664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:47 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Volume 35a1a408-a5ea-4c40-a59e-247501880bee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35a1a408-a5ea-4c40-a59e-247501880bee', 'volume_size': 1} Apr 16 23:00:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:47 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:00:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Flow 'volume_create_manager' (63c7c8aa-470e-4eb4-afac-c51fc1dddd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:00:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0f4e3b6-37a7-494b-bfbc-e6d8b0cb7584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0f4e3b6-37a7-494b-bfbc-e6d8b0cb7584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1704145364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5bfeaf5cf624e3785ff524cc8345045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:00:48Z,use_quota=True,user_id='7e3475761c3e4374b4d92a7242f67fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1325794d-d3b1-445b-acc2-6e8a5a447694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1325794d-d3b1-445b-acc2-6e8a5a447694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eae89a3-5b4c-4744-bc7b-96723f23c3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eae89a3-5b4c-4744-bc7b-96723f23c3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826', 'volume_name': 'volume-bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eafa3f93-6c27-4a56-a547-94c355591c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eafa3f93-6c27-4a56-a547-94c355591c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ab8edd-15c2-4077-9dfa-908751b978ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:47 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Volume bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826', 'volume_size': 1} Apr 16 23:00:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:48 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-96d888d7-c4b9-497c-8a9d-8f70591bc6b7 tempest-GroupsV320Test-906205918 None] Group tempest-GroupsV320Test-Group-1520432804: creating Apr 16 23:00:48 devstack sudo[87052]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:48 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:00:48 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Flow 'volume_create_manager' (16125d44-5967-4f2e-a45c-2f7def9e7ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:00:48 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86cd1540-7b99-456a-a9cd-8a8e49fe1751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cc28f519-f74d-4cfa-8aa5-7416203a7064 tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e 1G" returned: 0 in 1.679s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:48 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-96d888d7-c4b9-497c-8a9d-8f70591bc6b7 tempest-GroupsV320Test-906205918 None] Group tempest-GroupsV320Test-Group-1520432804: created successfully Apr 16 23:00:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cc28f519-f74d-4cfa-8aa5-7416203a7064 tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:48 devstack sudo[87058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e Apr 16 23:00:48 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:48 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86cd1540-7b99-456a-a9cd-8a8e49fe1751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-562718346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=201e48c6-a5cb-4559-8909-d0e4778891d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5bfeaf5cf624e3785ff524cc8345045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:00:48Z,use_quota=True,user_id='7e3475761c3e4374b4d92a7242f67fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:48 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c1e32d-54d6-4ece-9659-7c1632aa3e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:48 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c1e32d-54d6-4ece-9659-7c1632aa3e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:48 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f97513-1129-46c7-b99e-aed681c92e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:48 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f97513-1129-46c7-b99e-aed681c92e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '201e48c6-a5cb-4559-8909-d0e4778891d0', 'volume_name': 'volume-201e48c6-a5cb-4559-8909-d0e4778891d0', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:48 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a910a5d9-bf20-4022-a2cb-46331072bb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:48 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a910a5d9-bf20-4022-a2cb-46331072bb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:48 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ef29b9-e622-4ec5-b2ab-7ede7a18b854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:48 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Volume 201e48c6-a5cb-4559-8909-d0e4778891d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-201e48c6-a5cb-4559-8909-d0e4778891d0', 'volume_size': 1} Apr 16 23:00:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:48 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-96d888d7-c4b9-497c-8a9d-8f70591bc6b7 tempest-GroupsV320Test-906205918 None] Create group completed successfully. Apr 16 23:00:49 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cc28f519-f74d-4cfa-8aa5-7416203a7064 tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e" returned: 0 in 0.959s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:49 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-cc28f519-f74d-4cfa-8aa5-7416203a7064 tempest-VolumesSnapshotListTestJSON-1064752421 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e is being set with open permissions: ugo+rw Apr 16 23:00:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cc28f519-f74d-4cfa-8aa5-7416203a7064 tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:49 devstack sudo[87085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e Apr 16 23:00:49 devstack sudo[87085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:49 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-71b7feb5-908d-43cc-8e82-ec8438682bfd tempest-GroupsV320Test-906205918 None] Created reservations ['522c6615-10d4-4bb1-9038-2e6b60d95040'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:00:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-71b7feb5-908d-43cc-8e82-ec8438682bfd tempest-GroupsV320Test-906205918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-71b7feb5-908d-43cc-8e82-ec8438682bfd tempest-GroupsV320Test-906205918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:50 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-71b7feb5-908d-43cc-8e82-ec8438682bfd tempest-GroupsV320Test-906205918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:00:50 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-71b7feb5-908d-43cc-8e82-ec8438682bfd tempest-GroupsV320Test-906205918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:00:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-71b7feb5-908d-43cc-8e82-ec8438682bfd tempest-GroupsV320Test-906205918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-71b7feb5-908d-43cc-8e82-ec8438682bfd tempest-GroupsV320Test-906205918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:50 devstack sudo[87089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:00:50 devstack sudo[87089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:50 devstack sudo[87085]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cc28f519-f74d-4cfa-8aa5-7416203a7064 tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e" returned: 0 in 0.865s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-cc28f519-f74d-4cfa-8aa5-7416203a7064 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.119s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.506s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:50 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1138919840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4961757-ff3f-457b-87cc-993e2362d4cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5bfeaf5cf624e3785ff524cc8345045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:00:46Z,use_quota=True,user_id='7e3475761c3e4374b4d92a7242f67fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:00:50 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Creating volume d4961757-ff3f-457b-87cc-993e2362d4cc {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:00:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:50 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:00:50 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:00:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:50 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:00:50 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:00:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d4961757-ff3f-457b-87cc-993e2362d4cc 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:50 devstack sudo[87097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d4961757-ff3f-457b-87cc-993e2362d4cc 1073741824 Apr 16 23:00:50 devstack sudo[87097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:50 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-cc28f519-f74d-4cfa-8aa5-7416203a7064 tempest-VolumesSnapshotListTestJSON-1064752421 None] Create snapshot completed successfully Apr 16 23:00:50 devstack sudo[87089]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-71b7feb5-908d-43cc-8e82-ec8438682bfd tempest-GroupsV320Test-906205918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.687s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:50 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-71b7feb5-908d-43cc-8e82-ec8438682bfd tempest-GroupsV320Test-906205918 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:00:50 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-71b7feb5-908d-43cc-8e82-ec8438682bfd tempest-GroupsV320Test-906205918 None] Delete group completed successfully. Apr 16 23:00:51 devstack sudo[87097]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d4961757-ff3f-457b-87cc-993e2362d4cc 1073741824" returned: 0 in 0.848s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d4961757-ff3f-457b-87cc-993e2362d4cc {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:51 devstack sudo[87103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d4961757-ff3f-457b-87cc-993e2362d4cc Apr 16 23:00:51 devstack sudo[87103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b4c0c703-d535-4b97-bab9-e522a563fead tempest-VolumesSnapshotListTestJSON-1064752421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:52 devstack sudo[87103]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d4961757-ff3f-457b-87cc-993e2362d4cc" returned: 0 in 0.903s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:52 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:00:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.099s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:52 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2095339286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c45792-7328-45d2-a0f0-a861d92a805a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5bfeaf5cf624e3785ff524cc8345045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:00:47Z,use_quota=True,user_id='7e3475761c3e4374b4d92a7242f67fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:00:52 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Creating volume a7c45792-7328-45d2-a0f0-a861d92a805a {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:00:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:52 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:00:52 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:00:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:52 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:00:52 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:00:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a7c45792-7328-45d2-a0f0-a861d92a805a 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:52 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb511c8-76b2-45dc-8c48-e00d8569b4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4961757-ff3f-457b-87cc-993e2362d4cc', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:52 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df4bd723-bb65-4f4d-b7cf-e4fdbfbb2e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:52 devstack sudo[87109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a7c45792-7328-45d2-a0f0-a861d92a805a 1073741824 Apr 16 23:00:52 devstack sudo[87109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:52 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Volume volume-d4961757-ff3f-457b-87cc-993e2362d4cc (d4961757-ff3f-457b-87cc-993e2362d4cc): created successfully Apr 16 23:00:52 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df4bd723-bb65-4f4d-b7cf-e4fdbfbb2e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:52 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Flow 'volume_create_manager' (fd007409-04b4-4941-b7b4-207cac7a114c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:00:52 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-959150a8-3cd6-4483-ae2b-3ab13d3de529 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Created volume successfully. Apr 16 23:00:53 devstack sudo[87109]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a7c45792-7328-45d2-a0f0-a861d92a805a 1073741824" returned: 0 in 0.931s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a7c45792-7328-45d2-a0f0-a861d92a805a {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:53 devstack sudo[87115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a7c45792-7328-45d2-a0f0-a861d92a805a Apr 16 23:00:53 devstack sudo[87115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:53 devstack sudo[87115]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a7c45792-7328-45d2-a0f0-a861d92a805a" returned: 0 in 0.567s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:53 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:00:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.240s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:53 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1575216629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35a1a408-a5ea-4c40-a59e-247501880bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5bfeaf5cf624e3785ff524cc8345045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:00:47Z,use_quota=True,user_id='7e3475761c3e4374b4d92a7242f67fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:00:53 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Creating volume 35a1a408-a5ea-4c40-a59e-247501880bee {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:00:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:53 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:00:53 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:00:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:53 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:00:53 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:00:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-35a1a408-a5ea-4c40-a59e-247501880bee 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (255ed564-8c58-41e1-9711-018b412d381c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7c45792-7328-45d2-a0f0-a861d92a805a', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:53 devstack sudo[87118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-35a1a408-a5ea-4c40-a59e-247501880bee 1073741824 Apr 16 23:00:53 devstack sudo[87118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b07998ca-b0cf-4dd5-8ea1-dd848775885b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:53 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Volume volume-a7c45792-7328-45d2-a0f0-a861d92a805a (a7c45792-7328-45d2-a0f0-a861d92a805a): created successfully Apr 16 23:00:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b07998ca-b0cf-4dd5-8ea1-dd848775885b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Flow 'volume_create_manager' (07b4960a-bedc-49ed-ad96-b4f648dd3a82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:00:53 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-239a475a-c834-4125-a3aa-7098a11c266c tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Created volume successfully. Apr 16 23:00:54 devstack sudo[87118]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-35a1a408-a5ea-4c40-a59e-247501880bee 1073741824" returned: 0 in 1.099s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-35a1a408-a5ea-4c40-a59e-247501880bee {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:54 devstack sudo[87151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-35a1a408-a5ea-4c40-a59e-247501880bee Apr 16 23:00:54 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:55 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-35a1a408-a5ea-4c40-a59e-247501880bee" returned: 0 in 0.674s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:55 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:00:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.817s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.705s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:55 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1704145364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5bfeaf5cf624e3785ff524cc8345045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:00:48Z,use_quota=True,user_id='7e3475761c3e4374b4d92a7242f67fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:00:55 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Creating volume bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:00:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:55 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:00:55 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:00:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:55 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:00:55 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:00:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2255093d-dc7c-4e1e-b155-a2f4e8805664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35a1a408-a5ea-4c40-a59e-247501880bee', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:55 devstack sudo[87155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826 1073741824 Apr 16 23:00:55 devstack sudo[87155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6484baf2-e95b-4dd8-888c-faba01d1eb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:55 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Volume volume-35a1a408-a5ea-4c40-a59e-247501880bee (35a1a408-a5ea-4c40-a59e-247501880bee): created successfully Apr 16 23:00:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6484baf2-e95b-4dd8-888c-faba01d1eb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Flow 'volume_create_manager' (b5b0c732-9712-4fb8-a21a-15632df74a60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:00:55 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-e2c90a23-7378-425f-84c9-a3236b2d4dec tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Created volume successfully. Apr 16 23:00:56 devstack sudo[87155]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826 1073741824" returned: 0 in 1.115s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:56 devstack sudo[87160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826 Apr 16 23:00:56 devstack sudo[87160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Flow 'volume_create_manager' (a77e262a-c880-4682-a9de-92114d30ea5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fddebd8-31b3-4d1f-83ff-60658ab3a0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fddebd8-31b3-4d1f-83ff-60658ab3a0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-602645080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240b8813-d108-4d0e-8cff-1de7b40fa2d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8c3be563f04db3b44a2994c20574a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:00:57Z,use_quota=True,user_id='ab18918901444d559c823df812aa42ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde4142a-ea03-4ea4-a0eb-4006f9d3b02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde4142a-ea03-4ea4-a0eb-4006f9d3b02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6832f8ed-8a28-478d-b86f-9b2a677074a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6832f8ed-8a28-478d-b86f-9b2a677074a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '240b8813-d108-4d0e-8cff-1de7b40fa2d1', 'volume_name': 'volume-240b8813-d108-4d0e-8cff-1de7b40fa2d1', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c05a479-5cd5-418f-8edf-e62435859ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c05a479-5cd5-418f-8edf-e62435859ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490f376d-1c32-4171-851a-c53df664985b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:57 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Volume 240b8813-d108-4d0e-8cff-1de7b40fa2d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-240b8813-d108-4d0e-8cff-1de7b40fa2d1', 'volume_size': 1} Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:57 devstack sudo[87160]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826" returned: 0 in 0.930s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] <== create_volume: return (2097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.104s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.100s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-562718346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=201e48c6-a5cb-4559-8909-d0e4778891d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5bfeaf5cf624e3785ff524cc8345045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:00:48Z,use_quota=True,user_id='7e3475761c3e4374b4d92a7242f67fdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Creating volume 201e48c6-a5cb-4559-8909-d0e4778891d0 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:00:57 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-201e48c6-a5cb-4559-8909-d0e4778891d0 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ab8edd-15c2-4077-9dfa-908751b978ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:57 devstack sudo[87163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-201e48c6-a5cb-4559-8909-d0e4778891d0 1073741824 Apr 16 23:00:57 devstack sudo[87163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fbba438-ad58-4d55-b47d-1598efcf778c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:57 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Volume volume-bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826 (bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826): created successfully Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fbba438-ad58-4d55-b47d-1598efcf778c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Flow 'volume_create_manager' (63c7c8aa-470e-4eb4-afac-c51fc1dddd0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:00:57 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-b70ef3cb-016c-4ab9-8fed-ab9d1d698174 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Created volume successfully. Apr 16 23:00:58 devstack sudo[87163]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-201e48c6-a5cb-4559-8909-d0e4778891d0 1073741824" returned: 0 in 1.329s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-201e48c6-a5cb-4559-8909-d0e4778891d0 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:59 devstack sudo[87203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-201e48c6-a5cb-4559-8909-d0e4778891d0 Apr 16 23:00:59 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:00:59 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root Apr 16 23:00:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-201e48c6-a5cb-4559-8909-d0e4778891d0" returned: 0 in 0.766s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:00:59 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] <== create_volume: return (2179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:00:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.188s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:00:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b4c0c703-d535-4b97-bab9-e522a563fead tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.999s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:00:59 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-b4c0c703-d535-4b97-bab9-e522a563fead tempest-VolumesSnapshotListTestJSON-1064752421 None] Creating offline snapshot dfbceab5-9b90-43fc-bf4b-738593b52f83 of volume 11745c7e-4509-45b4-b845-96c95137ecda {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:00:59 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13ef29b9-e622-4ec5-b2ab-7ede7a18b854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-201e48c6-a5cb-4559-8909-d0e4778891d0', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:59 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e9cc1d-cb8e-416d-8a4f-83d974cfbd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:00:59 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89508bf-3699-4a51-884b-fb583a957b8e]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:00:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b4c0c703-d535-4b97-bab9-e522a563fead tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:00:59 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Volume volume-201e48c6-a5cb-4559-8909-d0e4778891d0 (201e48c6-a5cb-4559-8909-d0e4778891d0): created successfully Apr 16 23:00:59 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e9cc1d-cb8e-416d-8a4f-83d974cfbd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:00:59 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Flow 'volume_create_manager' (16125d44-5967-4f2e-a45c-2f7def9e7ce0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:00:59 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-c7d3fa21-6d6d-4a0d-8ca4-16b3ab39f346 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Created volume successfully. Apr 16 23:01:00 devstack sudo[87206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e Apr 16 23:01:00 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:00 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b4c0c703-d535-4b97-bab9-e522a563fead tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e" returned: 0 in 0.776s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:00 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-b4c0c703-d535-4b97-bab9-e522a563fead tempest-VolumesSnapshotListTestJSON-1064752421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11745c7e-4509-45b4-b845-96c95137ecda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:01:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b4c0c703-d535-4b97-bab9-e522a563fead tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.dfbceab5-9b90-43fc-bf4b-738593b52f83 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:00 devstack sudo[87211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.dfbceab5-9b90-43fc-bf4b-738593b52f83 1G Apr 16 23:01:00 devstack sudo[87211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6f7a79ed-3daf-46e2-8f8f-62bf56cada62 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "cinder-201e48c6-a5cb-4559-8909-d0e4778891d0-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6f7a79ed-3daf-46e2-8f8f-62bf56cada62 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "cinder-201e48c6-a5cb-4559-8909-d0e4778891d0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:01 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6f7a79ed-3daf-46e2-8f8f-62bf56cada62 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "cinder-quobyte-201e48c6-a5cb-4559-8909-d0e4778891d0" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:01 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6f7a79ed-3daf-46e2-8f8f-62bf56cada62 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "cinder-quobyte-201e48c6-a5cb-4559-8909-d0e4778891d0" acquired by "delete_volume" :: waited 0.020s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:01 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3c345c-94b1-4af4-aa35-515363e7a619]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6f7a79ed-3daf-46e2-8f8f-62bf56cada62 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-201e48c6-a5cb-4559-8909-d0e4778891d0 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:01 devstack sudo[87213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-201e48c6-a5cb-4559-8909-d0e4778891d0 Apr 16 23:01:01 devstack sudo[87213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:01 devstack sudo[87211]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b4c0c703-d535-4b97-bab9-e522a563fead tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.dfbceab5-9b90-43fc-bf4b-738593b52f83 1G" returned: 0 in 1.237s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b4c0c703-d535-4b97-bab9-e522a563fead tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.dfbceab5-9b90-43fc-bf4b-738593b52f83 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:01 devstack sudo[87219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.dfbceab5-9b90-43fc-bf4b-738593b52f83 Apr 16 23:01:01 devstack sudo[87219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:02 devstack sudo[87213]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6f7a79ed-3daf-46e2-8f8f-62bf56cada62 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-201e48c6-a5cb-4559-8909-d0e4778891d0" returned: 0 in 1.249s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6f7a79ed-3daf-46e2-8f8f-62bf56cada62 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-201e48c6-a5cb-4559-8909-d0e4778891d0 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:02 devstack sudo[87225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-201e48c6-a5cb-4559-8909-d0e4778891d0 Apr 16 23:01:02 devstack sudo[87225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:02 devstack sudo[87219]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b4c0c703-d535-4b97-bab9-e522a563fead tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.dfbceab5-9b90-43fc-bf4b-738593b52f83" returned: 0 in 0.880s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:02 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-b4c0c703-d535-4b97-bab9-e522a563fead tempest-VolumesSnapshotListTestJSON-1064752421 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.dfbceab5-9b90-43fc-bf4b-738593b52f83 is being set with open permissions: ugo+rw Apr 16 23:01:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b4c0c703-d535-4b97-bab9-e522a563fead tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.dfbceab5-9b90-43fc-bf4b-738593b52f83 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:02 devstack sudo[87230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.dfbceab5-9b90-43fc-bf4b-738593b52f83 Apr 16 23:01:02 devstack sudo[87230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:03 devstack sudo[87225]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6f7a79ed-3daf-46e2-8f8f-62bf56cada62 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-201e48c6-a5cb-4559-8909-d0e4778891d0" returned: 0 in 0.767s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:03 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6f7a79ed-3daf-46e2-8f8f-62bf56cada62 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "cinder-quobyte-201e48c6-a5cb-4559-8909-d0e4778891d0" released by "delete_volume" :: held 2.077s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:03 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-6f7a79ed-3daf-46e2-8f8f-62bf56cada62 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Created reservations ['3f903520-8776-4170-a9b6-17ff4504ab6b', '71b5bbce-8cde-4e1f-bae4-d71cc2d6046b', '18b83552-6450-4b44-ab6b-49b92d066a72', '445676c9-73b7-431a-8b53-d7e1d312662a'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:01:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6f7a79ed-3daf-46e2-8f8f-62bf56cada62 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6f7a79ed-3daf-46e2-8f8f-62bf56cada62 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-6f7a79ed-3daf-46e2-8f8f-62bf56cada62 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-6f7a79ed-3daf-46e2-8f8f-62bf56cada62 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6f7a79ed-3daf-46e2-8f8f-62bf56cada62 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6f7a79ed-3daf-46e2-8f8f-62bf56cada62 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:03 devstack sudo[87234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:01:03 devstack sudo[87230]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:03 devstack sudo[87234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b4c0c703-d535-4b97-bab9-e522a563fead tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.dfbceab5-9b90-43fc-bf4b-738593b52f83" returned: 0 in 0.609s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b4c0c703-d535-4b97-bab9-e522a563fead tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.643s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.032s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-602645080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240b8813-d108-4d0e-8cff-1de7b40fa2d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8c3be563f04db3b44a2994c20574a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:00:57Z,use_quota=True,user_id='ab18918901444d559c823df812aa42ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:01:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Creating volume 240b8813-d108-4d0e-8cff-1de7b40fa2d1 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:01:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:01:03 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:01:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-240b8813-d108-4d0e-8cff-1de7b40fa2d1 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:03 devstack sudo[87238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-240b8813-d108-4d0e-8cff-1de7b40fa2d1 1073741824 Apr 16 23:01:03 devstack sudo[87238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:03 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-b4c0c703-d535-4b97-bab9-e522a563fead tempest-VolumesSnapshotListTestJSON-1064752421 None] Create snapshot completed successfully Apr 16 23:01:04 devstack sudo[87234]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6f7a79ed-3daf-46e2-8f8f-62bf56cada62 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.804s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:04 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-6f7a79ed-3daf-46e2-8f8f-62bf56cada62 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:01:04 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-6f7a79ed-3daf-46e2-8f8f-62bf56cada62 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Deleted volume successfully. Apr 16 23:01:04 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6f7a79ed-3daf-46e2-8f8f-62bf56cada62 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "cinder-201e48c6-a5cb-4559-8909-d0e4778891d0-delete_volume" released by "delete_volume" :: held 3.220s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:04 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5f222646-3417-412d-8ac1-0379f0ef61d9 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "cinder-bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:04 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5f222646-3417-412d-8ac1-0379f0ef61d9 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "cinder-bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:04 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:UPDATE=120,cinder:SELECT=96,cinder:DELETE=11,cinder:INSERT=25 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 23:01:04 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5f222646-3417-412d-8ac1-0379f0ef61d9 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "cinder-quobyte-bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:04 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5f222646-3417-412d-8ac1-0379f0ef61d9 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "cinder-quobyte-bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826" acquired by "delete_volume" :: waited 0.015s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:04 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27ef6dc-81c7-414d-bde3-4894e35ccb23]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5f222646-3417-412d-8ac1-0379f0ef61d9 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:04 devstack sudo[87298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826 Apr 16 23:01:04 devstack sudo[87298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:04 devstack sudo[87238]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-240b8813-d108-4d0e-8cff-1de7b40fa2d1 1073741824" returned: 0 in 1.279s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-240b8813-d108-4d0e-8cff-1de7b40fa2d1 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:04 devstack cinder-volume[81971]: DEBUG oslo_service.periodic_task [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81971) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 23:01:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:04 devstack sudo[87300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-240b8813-d108-4d0e-8cff-1de7b40fa2d1 Apr 16 23:01:04 devstack sudo[87300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:04 devstack sudo[87301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:01:04 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:05 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-9d3390c6-5631-498a-b5c8-3e867b28863f tempest-VolumesSnapshotListTestJSON-1064752421 None] Acquiring lock "cinder-dfbceab5-9b90-43fc-bf4b-738593b52f83-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:05 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-9d3390c6-5631-498a-b5c8-3e867b28863f tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "cinder-dfbceab5-9b90-43fc-bf4b-738593b52f83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:05 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-9d3390c6-5631-498a-b5c8-3e867b28863f tempest-VolumesSnapshotListTestJSON-1064752421 None] Acquiring lock "cinder-quobyte-11745c7e-4509-45b4-b845-96c95137ecda" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:05 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-9d3390c6-5631-498a-b5c8-3e867b28863f tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "cinder-quobyte-11745c7e-4509-45b4-b845-96c95137ecda" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:05 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-9d3390c6-5631-498a-b5c8-3e867b28863f tempest-VolumesSnapshotListTestJSON-1064752421 None] Acquiring lock "cinder-quobyte-dfbceab5-9b90-43fc-bf4b-738593b52f83" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:05 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-9d3390c6-5631-498a-b5c8-3e867b28863f tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "cinder-quobyte-dfbceab5-9b90-43fc-bf4b-738593b52f83" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:05 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-9d3390c6-5631-498a-b5c8-3e867b28863f tempest-VolumesSnapshotListTestJSON-1064752421 None] Deleting offline snapshot dfbceab5-9b90-43fc-bf4b-738593b52f83 of volume 11745c7e-4509-45b4-b845-96c95137ecda {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:01:05 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-9d3390c6-5631-498a-b5c8-3e867b28863f tempest-VolumesSnapshotListTestJSON-1064752421 None] snapshot_file for this snap is: volume-11745c7e-4509-45b4-b845-96c95137ecda.dfbceab5-9b90-43fc-bf4b-738593b52f83 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:01:05 devstack sudo[87298]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5f222646-3417-412d-8ac1-0379f0ef61d9 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826" returned: 0 in 1.429s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5f222646-3417-412d-8ac1-0379f0ef61d9 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:05 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[28313813-e740-4503-9d04-939e5d447ba7]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9d3390c6-5631-498a-b5c8-3e867b28863f tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.dfbceab5-9b90-43fc-bf4b-738593b52f83 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:05 devstack sudo[87308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826 Apr 16 23:01:06 devstack sudo[87308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:06 devstack sudo[87310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.dfbceab5-9b90-43fc-bf4b-738593b52f83 Apr 16 23:01:06 devstack sudo[87310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:06 devstack sudo[87300]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-240b8813-d108-4d0e-8cff-1de7b40fa2d1" returned: 0 in 1.286s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] <== create_volume: return (2653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:01:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.656s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:06 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490f376d-1c32-4171-851a-c53df664985b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-240b8813-d108-4d0e-8cff-1de7b40fa2d1', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:06 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62e3339-2c2f-4e23-8db0-ca1ceee5b270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:06 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Volume volume-240b8813-d108-4d0e-8cff-1de7b40fa2d1 (240b8813-d108-4d0e-8cff-1de7b40fa2d1): created successfully Apr 16 23:01:06 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62e3339-2c2f-4e23-8db0-ca1ceee5b270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:06 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Flow 'volume_create_manager' (a77e262a-c880-4682-a9de-92114d30ea5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:01:06 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-2a06863e-7fd7-4ec9-bb40-b107b4ac5f71 tempest-ServerRescueNegativeTestJSON-1049192490 None] Created volume successfully. Apr 16 23:01:06 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 1.451s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:06 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:01:06 devstack sudo[87310]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9d3390c6-5631-498a-b5c8-3e867b28863f tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.dfbceab5-9b90-43fc-bf4b-738593b52f83" returned: 0 in 0.774s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-9d3390c6-5631-498a-b5c8-3e867b28863f tempest-VolumesSnapshotListTestJSON-1064752421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11745c7e-4509-45b4-b845-96c95137ecda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:01:06 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[e862c805-2109-4578-a7be-ad2577cc1635]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9d3390c6-5631-498a-b5c8-3e867b28863f tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:06 devstack sudo[87316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e Apr 16 23:01:06 devstack sudo[87316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:07 devstack sudo[87308]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5f222646-3417-412d-8ac1-0379f0ef61d9 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826" returned: 0 in 1.187s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:07 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5f222646-3417-412d-8ac1-0379f0ef61d9 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "cinder-quobyte-bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826" released by "delete_volume" :: held 2.680s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:07 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-5f222646-3417-412d-8ac1-0379f0ef61d9 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Created reservations ['45817064-8d90-41d7-8054-8e2ced47854f', '7bd6ce9f-acca-4fa4-837d-4200d3a305a1', 'c8d10548-8204-4aec-8983-1b8d96c93162', '4718879a-195c-42c9-abe4-0a857b374466'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:01:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5f222646-3417-412d-8ac1-0379f0ef61d9 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5f222646-3417-412d-8ac1-0379f0ef61d9 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5f222646-3417-412d-8ac1-0379f0ef61d9 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5f222646-3417-412d-8ac1-0379f0ef61d9 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5f222646-3417-412d-8ac1-0379f0ef61d9 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5f222646-3417-412d-8ac1-0379f0ef61d9 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:07 devstack sudo[87320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:01:07 devstack sudo[87320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:07 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7ebc11a8-08cf-44d6-82dc-6436e0b56460 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "cinder-35a1a408-a5ea-4c40-a59e-247501880bee-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:07 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7ebc11a8-08cf-44d6-82dc-6436e0b56460 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "cinder-35a1a408-a5ea-4c40-a59e-247501880bee-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:07 devstack sudo[87316]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9d3390c6-5631-498a-b5c8-3e867b28863f tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e" returned: 0 in 1.223s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:08 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7ebc11a8-08cf-44d6-82dc-6436e0b56460 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "cinder-quobyte-35a1a408-a5ea-4c40-a59e-247501880bee" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:08 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-9d3390c6-5631-498a-b5c8-3e867b28863f tempest-VolumesSnapshotListTestJSON-1064752421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11745c7e-4509-45b4-b845-96c95137ecda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:01:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9d3390c6-5631-498a-b5c8-3e867b28863f tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.dfbceab5-9b90-43fc-bf4b-738593b52f83 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:08 devstack sudo[87325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.dfbceab5-9b90-43fc-bf4b-738593b52f83 Apr 16 23:01:08 devstack sudo[87325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:08 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7ebc11a8-08cf-44d6-82dc-6436e0b56460 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "cinder-quobyte-35a1a408-a5ea-4c40-a59e-247501880bee" acquired by "delete_volume" :: waited 0.055s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:08 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[80529a2e-7d2b-482f-9071-8478c36bfc51]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7ebc11a8-08cf-44d6-82dc-6436e0b56460 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-35a1a408-a5ea-4c40-a59e-247501880bee {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:08 devstack sudo[87328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-35a1a408-a5ea-4c40-a59e-247501880bee Apr 16 23:01:08 devstack sudo[87328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:08 devstack sudo[87320]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5f222646-3417-412d-8ac1-0379f0ef61d9 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 1.015s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:08 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-5f222646-3417-412d-8ac1-0379f0ef61d9 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:01:08 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-5f222646-3417-412d-8ac1-0379f0ef61d9 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Deleted volume successfully. Apr 16 23:01:08 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5f222646-3417-412d-8ac1-0379f0ef61d9 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "cinder-bc3e98ae-a1ea-4bc1-8c8d-9b9dde0ab826-delete_volume" released by "delete_volume" :: held 3.973s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:09 devstack sudo[87328]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7ebc11a8-08cf-44d6-82dc-6436e0b56460 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-35a1a408-a5ea-4c40-a59e-247501880bee" returned: 0 in 1.231s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7ebc11a8-08cf-44d6-82dc-6436e0b56460 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-35a1a408-a5ea-4c40-a59e-247501880bee {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:09 devstack sudo[87336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-35a1a408-a5ea-4c40-a59e-247501880bee Apr 16 23:01:09 devstack sudo[87336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:09 devstack sudo[87325]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9d3390c6-5631-498a-b5c8-3e867b28863f tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.dfbceab5-9b90-43fc-bf4b-738593b52f83" returned: 0 in 1.692s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9d3390c6-5631-498a-b5c8-3e867b28863f tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.dfbceab5-9b90-43fc-bf4b-738593b52f83 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:09 devstack sudo[87338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.dfbceab5-9b90-43fc-bf4b-738593b52f83 Apr 16 23:01:09 devstack sudo[87338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:10 devstack sudo[87336]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7ebc11a8-08cf-44d6-82dc-6436e0b56460 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-35a1a408-a5ea-4c40-a59e-247501880bee" returned: 0 in 1.000s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Flow 'volume_create_manager' (5581d665-3f67-4157-b09f-4ae1f7f407d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ad87a5-dfc2-44df-8c09-c4dbfc5fc99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7ebc11a8-08cf-44d6-82dc-6436e0b56460 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "cinder-quobyte-35a1a408-a5ea-4c40-a59e-247501880bee" released by "delete_volume" :: held 2.331s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ad87a5-dfc2-44df-8c09-c4dbfc5fc99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2027164847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07829d48-ebb4-4f28-a49e-8e2bbaf049f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa7df95ad234d41b33d6b3994f069da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:01:10Z,use_quota=True,user_id='0149ed984ea24da194d5526a5c5b1c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50715cd4-97fc-4d70-a036-b1fecd719abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50715cd4-97fc-4d70-a036-b1fecd719abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce597d6-fa06-4d3f-a08c-06a2eddae55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce597d6-fa06-4d3f-a08c-06a2eddae55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07829d48-ebb4-4f28-a49e-8e2bbaf049f1', 'volume_name': 'volume-07829d48-ebb4-4f28-a49e-8e2bbaf049f1', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801dfc3f-902b-44ed-9d88-a7cb37cf6fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (801dfc3f-902b-44ed-9d88-a7cb37cf6fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc150d0-7227-452c-82c0-fa34bd37065d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:10 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Volume 07829d48-ebb4-4f28-a49e-8e2bbaf049f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07829d48-ebb4-4f28-a49e-8e2bbaf049f1', 'volume_size': 1} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2027164847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07829d48-ebb4-4f28-a49e-8e2bbaf049f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa7df95ad234d41b33d6b3994f069da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:01:10Z,use_quota=True,user_id='0149ed984ea24da194d5526a5c5b1c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Creating volume 07829d48-ebb4-4f28-a49e-8e2bbaf049f1 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:01:10 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-07829d48-ebb4-4f28-a49e-8e2bbaf049f1 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-7ebc11a8-08cf-44d6-82dc-6436e0b56460 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Created reservations ['5b2af459-cd68-487a-a058-569127320ab0', '1416abe9-880f-4c6b-88b6-c1c1ef94cc75', '18ef27d9-2ecd-46f0-aff8-f3497c4d644e', '4ee855da-4393-403f-9e57-f40144d315cb'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:01:10 devstack sudo[87342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-07829d48-ebb4-4f28-a49e-8e2bbaf049f1 1073741824 Apr 16 23:01:10 devstack sudo[87342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-7ebc11a8-08cf-44d6-82dc-6436e0b56460 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-7ebc11a8-08cf-44d6-82dc-6436e0b56460 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-7ebc11a8-08cf-44d6-82dc-6436e0b56460 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-7ebc11a8-08cf-44d6-82dc-6436e0b56460 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-7ebc11a8-08cf-44d6-82dc-6436e0b56460 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7ebc11a8-08cf-44d6-82dc-6436e0b56460 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:10 devstack sudo[87348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:01:10 devstack sudo[87348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:10 devstack sudo[87338]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9d3390c6-5631-498a-b5c8-3e867b28863f tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.dfbceab5-9b90-43fc-bf4b-738593b52f83" returned: 0 in 1.010s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-9d3390c6-5631-498a-b5c8-3e867b28863f tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "cinder-quobyte-dfbceab5-9b90-43fc-bf4b-738593b52f83" released by "_delete_snapshot" :: held 4.869s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-9d3390c6-5631-498a-b5c8-3e867b28863f tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "cinder-quobyte-11745c7e-4509-45b4-b845-96c95137ecda" released by "delete_snapshot" :: held 4.899s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-9d3390c6-5631-498a-b5c8-3e867b28863f tempest-VolumesSnapshotListTestJSON-1064752421 None] Created reservations ['36d3940c-5f9b-48ab-ae31-1adbc6e731fe', '1897d014-12c3-409a-90e2-152751110baa', '286842f3-1661-47ce-8b37-b279eba1e62e', 'a54cdd58-46de-4155-a115-69af33fe6c84'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:01:10 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-9d3390c6-5631-498a-b5c8-3e867b28863f tempest-VolumesSnapshotListTestJSON-1064752421 None] Delete snapshot completed successfully. Apr 16 23:01:10 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-9d3390c6-5631-498a-b5c8-3e867b28863f tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "cinder-dfbceab5-9b90-43fc-bf4b-738593b52f83-delete_snapshot" released by "delete_snapshot" :: held 5.096s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5f6f56fa-e1f5-4d66-bd94-5cb0db7ec980 tempest-VolumesSnapshotListTestJSON-1064752421 None] Acquiring lock "cinder-01eedae1-b945-459b-b78c-0a718b471c3e-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5f6f56fa-e1f5-4d66-bd94-5cb0db7ec980 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "cinder-01eedae1-b945-459b-b78c-0a718b471c3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5f6f56fa-e1f5-4d66-bd94-5cb0db7ec980 tempest-VolumesSnapshotListTestJSON-1064752421 None] Acquiring lock "cinder-quobyte-11745c7e-4509-45b4-b845-96c95137ecda" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5f6f56fa-e1f5-4d66-bd94-5cb0db7ec980 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "cinder-quobyte-11745c7e-4509-45b4-b845-96c95137ecda" acquired by "delete_snapshot" :: waited 0.034s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5f6f56fa-e1f5-4d66-bd94-5cb0db7ec980 tempest-VolumesSnapshotListTestJSON-1064752421 None] Acquiring lock "cinder-quobyte-01eedae1-b945-459b-b78c-0a718b471c3e" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5f6f56fa-e1f5-4d66-bd94-5cb0db7ec980 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "cinder-quobyte-01eedae1-b945-459b-b78c-0a718b471c3e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-5f6f56fa-e1f5-4d66-bd94-5cb0db7ec980 tempest-VolumesSnapshotListTestJSON-1064752421 None] Deleting offline snapshot 01eedae1-b945-459b-b78c-0a718b471c3e of volume 11745c7e-4509-45b4-b845-96c95137ecda {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:01:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-5f6f56fa-e1f5-4d66-bd94-5cb0db7ec980 tempest-VolumesSnapshotListTestJSON-1064752421 None] snapshot_file for this snap is: volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:01:11 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72d1966-ac62-4d70-ad37-c4a6c251ec53]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5f6f56fa-e1f5-4d66-bd94-5cb0db7ec980 tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:11 devstack sudo[87348]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4ed3e825-151f-46b7-b0dc-820fdcd11942 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "cinder-a7c45792-7328-45d2-a0f0-a861d92a805a-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7ebc11a8-08cf-44d6-82dc-6436e0b56460 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.866s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:11 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-7ebc11a8-08cf-44d6-82dc-6436e0b56460 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:01:11 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-7ebc11a8-08cf-44d6-82dc-6436e0b56460 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Deleted volume successfully. Apr 16 23:01:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4ed3e825-151f-46b7-b0dc-820fdcd11942 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "cinder-a7c45792-7328-45d2-a0f0-a861d92a805a-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7ebc11a8-08cf-44d6-82dc-6436e0b56460 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "cinder-35a1a408-a5ea-4c40-a59e-247501880bee-delete_volume" released by "delete_volume" :: held 3.739s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:11 devstack sudo[87388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e Apr 16 23:01:11 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4ed3e825-151f-46b7-b0dc-820fdcd11942 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "cinder-quobyte-a7c45792-7328-45d2-a0f0-a861d92a805a" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4ed3e825-151f-46b7-b0dc-820fdcd11942 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "cinder-quobyte-a7c45792-7328-45d2-a0f0-a861d92a805a" acquired by "delete_volume" :: waited 0.023s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:11 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc14f6c0-259d-4e7c-8ffb-6cfa0f867e55]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4ed3e825-151f-46b7-b0dc-820fdcd11942 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a7c45792-7328-45d2-a0f0-a861d92a805a {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:11 devstack sudo[87342]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-07829d48-ebb4-4f28-a49e-8e2bbaf049f1 1073741824" returned: 0 in 1.266s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-07829d48-ebb4-4f28-a49e-8e2bbaf049f1 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:11 devstack sudo[87395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-07829d48-ebb4-4f28-a49e-8e2bbaf049f1 Apr 16 23:01:11 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:12 devstack sudo[87394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a7c45792-7328-45d2-a0f0-a861d92a805a Apr 16 23:01:12 devstack sudo[87394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:12 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5f6f56fa-e1f5-4d66-bd94-5cb0db7ec980 tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e" returned: 0 in 0.952s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-5f6f56fa-e1f5-4d66-bd94-5cb0db7ec980 tempest-VolumesSnapshotListTestJSON-1064752421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11745c7e-4509-45b4-b845-96c95137ecda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:01:12 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20c0fdc-290e-4aca-a76d-7271b66742c8]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5f6f56fa-e1f5-4d66-bd94-5cb0db7ec980 tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:12 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-07829d48-ebb4-4f28-a49e-8e2bbaf049f1" returned: 0 in 0.738s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:01:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.077s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:12 devstack sudo[87408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317 Apr 16 23:01:12 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:12 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc150d0-7227-452c-82c0-fa34bd37065d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07829d48-ebb4-4f28-a49e-8e2bbaf049f1', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:12 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac468194-6766-4f43-95ba-3ca3d6de2963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:12 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Volume volume-07829d48-ebb4-4f28-a49e-8e2bbaf049f1 (07829d48-ebb4-4f28-a49e-8e2bbaf049f1): created successfully Apr 16 23:01:12 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac468194-6766-4f43-95ba-3ca3d6de2963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:12 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Flow 'volume_create_manager' (5581d665-3f67-4157-b09f-4ae1f7f407d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:01:12 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-5e7f7105-9063-4650-af15-c76686eec022 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Created volume successfully. Apr 16 23:01:12 devstack sudo[87394]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4ed3e825-151f-46b7-b0dc-820fdcd11942 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a7c45792-7328-45d2-a0f0-a861d92a805a" returned: 0 in 0.968s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4ed3e825-151f-46b7-b0dc-820fdcd11942 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a7c45792-7328-45d2-a0f0-a861d92a805a {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:12 devstack sudo[87418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a7c45792-7328-45d2-a0f0-a861d92a805a Apr 16 23:01:12 devstack sudo[87418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:13 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5f6f56fa-e1f5-4d66-bd94-5cb0db7ec980 tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317" returned: 0 in 0.601s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-5f6f56fa-e1f5-4d66-bd94-5cb0db7ec980 tempest-VolumesSnapshotListTestJSON-1064752421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11745c7e-4509-45b4-b845-96c95137ecda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5f6f56fa-e1f5-4d66-bd94-5cb0db7ec980 tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:13 devstack sudo[87424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e Apr 16 23:01:13 devstack sudo[87424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:13 devstack sudo[87418]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4ed3e825-151f-46b7-b0dc-820fdcd11942 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a7c45792-7328-45d2-a0f0-a861d92a805a" returned: 0 in 0.485s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4ed3e825-151f-46b7-b0dc-820fdcd11942 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "cinder-quobyte-a7c45792-7328-45d2-a0f0-a861d92a805a" released by "delete_volume" :: held 1.499s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-4ed3e825-151f-46b7-b0dc-820fdcd11942 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Created reservations ['9f8be421-312a-4ce9-a461-f1985ca1adfd', '0affed34-c5a1-4f9b-b3ef-01d45776367a', 'da95e030-e969-474c-a248-255ad6a47dc4', '8145627f-7ca2-418d-a329-6babf687a3a0'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-4ed3e825-151f-46b7-b0dc-820fdcd11942 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-4ed3e825-151f-46b7-b0dc-820fdcd11942 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-4ed3e825-151f-46b7-b0dc-820fdcd11942 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-4ed3e825-151f-46b7-b0dc-820fdcd11942 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-4ed3e825-151f-46b7-b0dc-820fdcd11942 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4ed3e825-151f-46b7-b0dc-820fdcd11942 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:13 devstack sudo[87426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:01:13 devstack sudo[87426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8a839c0d-01e0-479b-a641-1115a4cb2e99 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Acquiring lock "cinder-07829d48-ebb4-4f28-a49e-8e2bbaf049f1-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:13 devstack sudo[87424]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8a839c0d-01e0-479b-a641-1115a4cb2e99 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Lock "cinder-07829d48-ebb4-4f28-a49e-8e2bbaf049f1-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5f6f56fa-e1f5-4d66-bd94-5cb0db7ec980 tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e" returned: 0 in 0.725s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5f6f56fa-e1f5-4d66-bd94-5cb0db7ec980 tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:13 devstack sudo[87432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e Apr 16 23:01:13 devstack sudo[87432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8a839c0d-01e0-479b-a641-1115a4cb2e99 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Acquiring lock "cinder-quobyte-07829d48-ebb4-4f28-a49e-8e2bbaf049f1" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8a839c0d-01e0-479b-a641-1115a4cb2e99 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Lock "cinder-quobyte-07829d48-ebb4-4f28-a49e-8e2bbaf049f1" acquired by "delete_volume" :: waited 0.009s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-77fb87fd-b396-41e9-aebb-86b88cad7762 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "cinder-d4961757-ff3f-457b-87cc-993e2362d4cc-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc430453-60bc-4f61-8809-6f0d9ea7d228]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8a839c0d-01e0-479b-a641-1115a4cb2e99 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-07829d48-ebb4-4f28-a49e-8e2bbaf049f1 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-77fb87fd-b396-41e9-aebb-86b88cad7762 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "cinder-d4961757-ff3f-457b-87cc-993e2362d4cc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:13 devstack sudo[87426]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-77fb87fd-b396-41e9-aebb-86b88cad7762 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "cinder-quobyte-d4961757-ff3f-457b-87cc-993e2362d4cc" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4ed3e825-151f-46b7-b0dc-820fdcd11942 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.611s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-4ed3e825-151f-46b7-b0dc-820fdcd11942 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:01:13 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-4ed3e825-151f-46b7-b0dc-820fdcd11942 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Deleted volume successfully. Apr 16 23:01:13 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-77fb87fd-b396-41e9-aebb-86b88cad7762 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "cinder-quobyte-d4961757-ff3f-457b-87cc-993e2362d4cc" acquired by "delete_volume" :: waited 0.022s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4ed3e825-151f-46b7-b0dc-820fdcd11942 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "cinder-a7c45792-7328-45d2-a0f0-a861d92a805a-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:14 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ee15b6-a728-4382-b3cf-cf3fdb337d03]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77fb87fd-b396-41e9-aebb-86b88cad7762 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d4961757-ff3f-457b-87cc-993e2362d4cc {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:14 devstack sudo[87434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-07829d48-ebb4-4f28-a49e-8e2bbaf049f1 Apr 16 23:01:14 devstack sudo[87434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:14 devstack sudo[87436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d4961757-ff3f-457b-87cc-993e2362d4cc Apr 16 23:01:14 devstack sudo[87436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:14 devstack sudo[87432]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5f6f56fa-e1f5-4d66-bd94-5cb0db7ec980 tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.01eedae1-b945-459b-b78c-0a718b471c3e" returned: 0 in 0.634s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5f6f56fa-e1f5-4d66-bd94-5cb0db7ec980 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "cinder-quobyte-01eedae1-b945-459b-b78c-0a718b471c3e" released by "_delete_snapshot" :: held 3.070s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5f6f56fa-e1f5-4d66-bd94-5cb0db7ec980 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "cinder-quobyte-11745c7e-4509-45b4-b845-96c95137ecda" released by "delete_snapshot" :: held 3.102s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:14 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:SELECT=108,cinder:INSERT=30,cinder:UPDATE=135,cinder:DELETE=8 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 23:01:14 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-5f6f56fa-e1f5-4d66-bd94-5cb0db7ec980 tempest-VolumesSnapshotListTestJSON-1064752421 None] Created reservations ['68fbb919-40d6-4265-a4ed-f17d489beca3', '4d12f8fd-a998-46d2-85ee-6521c65054bd', 'ba188d57-0f7e-4294-89fc-63607eecaedc', '69cd74bd-5cfd-4eb3-9fa0-8ee577a86c03'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:01:14 devstack sudo[87434]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8a839c0d-01e0-479b-a641-1115a4cb2e99 tempest-VolumeQuotasAdminTestJSON-1197476318 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-07829d48-ebb4-4f28-a49e-8e2bbaf049f1" returned: 0 in 0.744s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8a839c0d-01e0-479b-a641-1115a4cb2e99 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-07829d48-ebb4-4f28-a49e-8e2bbaf049f1 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:14 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-5f6f56fa-e1f5-4d66-bd94-5cb0db7ec980 tempest-VolumesSnapshotListTestJSON-1064752421 None] Delete snapshot completed successfully. Apr 16 23:01:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5f6f56fa-e1f5-4d66-bd94-5cb0db7ec980 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "cinder-01eedae1-b945-459b-b78c-0a718b471c3e-delete_snapshot" released by "delete_snapshot" :: held 3.320s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:14 devstack sudo[87445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-07829d48-ebb4-4f28-a49e-8e2bbaf049f1 Apr 16 23:01:14 devstack sudo[87445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:14 devstack sudo[87436]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77fb87fd-b396-41e9-aebb-86b88cad7762 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d4961757-ff3f-457b-87cc-993e2362d4cc" returned: 0 in 0.703s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77fb87fd-b396-41e9-aebb-86b88cad7762 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d4961757-ff3f-457b-87cc-993e2362d4cc {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:14 devstack sudo[87447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d4961757-ff3f-457b-87cc-993e2362d4cc Apr 16 23:01:14 devstack sudo[87447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:15 devstack sudo[87445]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8a839c0d-01e0-479b-a641-1115a4cb2e99 tempest-VolumeQuotasAdminTestJSON-1197476318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-07829d48-ebb4-4f28-a49e-8e2bbaf049f1" returned: 0 in 0.531s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8a839c0d-01e0-479b-a641-1115a4cb2e99 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Lock "cinder-quobyte-07829d48-ebb4-4f28-a49e-8e2bbaf049f1" released by "delete_volume" :: held 1.316s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:15 devstack sudo[87447]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77fb87fd-b396-41e9-aebb-86b88cad7762 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d4961757-ff3f-457b-87cc-993e2362d4cc" returned: 0 in 0.480s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-77fb87fd-b396-41e9-aebb-86b88cad7762 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "cinder-quobyte-d4961757-ff3f-457b-87cc-993e2362d4cc" released by "delete_volume" :: held 1.226s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-8a839c0d-01e0-479b-a641-1115a4cb2e99 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Created reservations ['70bcf97d-574e-4b29-9932-9a4a8703b513', 'a6705f7a-9d9e-4cbb-82d3-7f02ff16ab95', 'f2c77db6-08a8-4f78-b4bb-7fc38709f173', '6d9be8b3-0861-4585-bf2d-75b3a7b4d75f'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-77fb87fd-b396-41e9-aebb-86b88cad7762 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Created reservations ['7b59ca2a-732b-4733-8f4b-f525c895067c', '554974b0-7ea0-47d4-ae91-4324bc631e02', '52217af9-d0de-41e6-a0c2-eb074a8d72dc', 'e6cfed9b-7ac2-4c4f-b50c-a5cf66d7dc74'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8a839c0d-01e0-479b-a641-1115a4cb2e99 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8a839c0d-01e0-479b-a641-1115a4cb2e99 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-8a839c0d-01e0-479b-a641-1115a4cb2e99 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-8a839c0d-01e0-479b-a641-1115a4cb2e99 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8a839c0d-01e0-479b-a641-1115a4cb2e99 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8a839c0d-01e0-479b-a641-1115a4cb2e99 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:15 devstack sudo[87452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:01:15 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77fb87fd-b396-41e9-aebb-86b88cad7762 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77fb87fd-b396-41e9-aebb-86b88cad7762 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77fb87fd-b396-41e9-aebb-86b88cad7762 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77fb87fd-b396-41e9-aebb-86b88cad7762 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77fb87fd-b396-41e9-aebb-86b88cad7762 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77fb87fd-b396-41e9-aebb-86b88cad7762 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:15 devstack sudo[87454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:01:15 devstack sudo[87454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5ea0821e-44de-44f0-a3c5-fea7bd69ee85 tempest-VolumesSnapshotListTestJSON-1064752421 None] Acquiring lock "cinder-9c01298d-5b2c-4fbf-af99-f70b5f0ff317-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5ea0821e-44de-44f0-a3c5-fea7bd69ee85 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "cinder-9c01298d-5b2c-4fbf-af99-f70b5f0ff317-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5ea0821e-44de-44f0-a3c5-fea7bd69ee85 tempest-VolumesSnapshotListTestJSON-1064752421 None] Acquiring lock "cinder-quobyte-11745c7e-4509-45b4-b845-96c95137ecda" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5ea0821e-44de-44f0-a3c5-fea7bd69ee85 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "cinder-quobyte-11745c7e-4509-45b4-b845-96c95137ecda" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5ea0821e-44de-44f0-a3c5-fea7bd69ee85 tempest-VolumesSnapshotListTestJSON-1064752421 None] Acquiring lock "cinder-quobyte-9c01298d-5b2c-4fbf-af99-f70b5f0ff317" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5ea0821e-44de-44f0-a3c5-fea7bd69ee85 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "cinder-quobyte-9c01298d-5b2c-4fbf-af99-f70b5f0ff317" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-5ea0821e-44de-44f0-a3c5-fea7bd69ee85 tempest-VolumesSnapshotListTestJSON-1064752421 None] Deleting offline snapshot 9c01298d-5b2c-4fbf-af99-f70b5f0ff317 of volume 11745c7e-4509-45b4-b845-96c95137ecda {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-5ea0821e-44de-44f0-a3c5-fea7bd69ee85 tempest-VolumesSnapshotListTestJSON-1064752421 None] snapshot_file for this snap is: volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[51da9580-89d5-44b8-a6dd-0de0c212e8d4]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5ea0821e-44de-44f0-a3c5-fea7bd69ee85 tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:15 devstack sudo[87456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317 Apr 16 23:01:15 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:15 devstack sudo[87454]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77fb87fd-b396-41e9-aebb-86b88cad7762 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.552s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-77fb87fd-b396-41e9-aebb-86b88cad7762 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:01:15 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-77fb87fd-b396-41e9-aebb-86b88cad7762 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Deleted volume successfully. Apr 16 23:01:15 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-77fb87fd-b396-41e9-aebb-86b88cad7762 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "cinder-d4961757-ff3f-457b-87cc-993e2362d4cc-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:16 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8a839c0d-01e0-479b-a641-1115a4cb2e99 tempest-VolumeQuotasAdminTestJSON-1197476318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.730s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-8a839c0d-01e0-479b-a641-1115a4cb2e99 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:01:16 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-8a839c0d-01e0-479b-a641-1115a4cb2e99 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Deleted volume successfully. Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8a839c0d-01e0-479b-a641-1115a4cb2e99 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Lock "cinder-07829d48-ebb4-4f28-a49e-8e2bbaf049f1-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6fc64014-e51c-4b6f-8cea-fa13d2536390 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "cinder-87c25ed0-c4cb-4632-977a-40fa27c47651-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6fc64014-e51c-4b6f-8cea-fa13d2536390 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "cinder-87c25ed0-c4cb-4632-977a-40fa27c47651-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6fc64014-e51c-4b6f-8cea-fa13d2536390 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "cinder-quobyte-87c25ed0-c4cb-4632-977a-40fa27c47651" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6fc64014-e51c-4b6f-8cea-fa13d2536390 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "cinder-quobyte-87c25ed0-c4cb-4632-977a-40fa27c47651" acquired by "delete_volume" :: waited 0.009s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[df442d4b-17c9-4e02-867d-e7c373223eb4]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6fc64014-e51c-4b6f-8cea-fa13d2536390 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-87c25ed0-c4cb-4632-977a-40fa27c47651 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:16 devstack sudo[87463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-87c25ed0-c4cb-4632-977a-40fa27c47651 Apr 16 23:01:16 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:16 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5ea0821e-44de-44f0-a3c5-fea7bd69ee85 tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317" returned: 0 in 0.820s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-5ea0821e-44de-44f0-a3c5-fea7bd69ee85 tempest-VolumesSnapshotListTestJSON-1064752421 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11745c7e-4509-45b4-b845-96c95137ecda(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6926ea-5d10-42cf-a6fd-a6a15a6eeb9c]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5ea0821e-44de-44f0-a3c5-fea7bd69ee85 tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Flow 'volume_create_manager' (0fa522fa-cc14-489f-a493-53e14eed6a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcbe0289-1ecf-43cf-9e76-2b67b997fc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcbe0289-1ecf-43cf-9e76-2b67b997fc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-460836837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d426707-99e2-4e05-86e1-92bef8470e0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa7df95ad234d41b33d6b3994f069da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:01:16Z,use_quota=True,user_id='0149ed984ea24da194d5526a5c5b1c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:16 devstack sudo[87492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda Apr 16 23:01:16 devstack sudo[87492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47706aaa-1819-4307-9b1c-123bb52dd2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47706aaa-1819-4307-9b1c-123bb52dd2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549aa376-73d6-4c92-bdf4-215619374bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549aa376-73d6-4c92-bdf4-215619374bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d426707-99e2-4e05-86e1-92bef8470e0c', 'volume_name': 'volume-7d426707-99e2-4e05-86e1-92bef8470e0c', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c32ddc-3f6d-42b6-9291-985d3afa24a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c32ddc-3f6d-42b6-9291-985d3afa24a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18937489-704f-4ffa-b768-db35738bc30c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:16 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Volume 7d426707-99e2-4e05-86e1-92bef8470e0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d426707-99e2-4e05-86e1-92bef8470e0c', 'volume_size': 1} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-460836837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d426707-99e2-4e05-86e1-92bef8470e0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7aa7df95ad234d41b33d6b3994f069da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:01:16Z,use_quota=True,user_id='0149ed984ea24da194d5526a5c5b1c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Creating volume 7d426707-99e2-4e05-86e1-92bef8470e0c {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:01:16 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:01:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7d426707-99e2-4e05-86e1-92bef8470e0c 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:17 devstack sudo[87495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7d426707-99e2-4e05-86e1-92bef8470e0c 1073741824 Apr 16 23:01:17 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:17 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6fc64014-e51c-4b6f-8cea-fa13d2536390 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-87c25ed0-c4cb-4632-977a-40fa27c47651" returned: 0 in 1.461s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6fc64014-e51c-4b6f-8cea-fa13d2536390 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-87c25ed0-c4cb-4632-977a-40fa27c47651 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:17 devstack sudo[87501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-87c25ed0-c4cb-4632-977a-40fa27c47651 Apr 16 23:01:17 devstack sudo[87501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:18 devstack sudo[87492]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5ea0821e-44de-44f0-a3c5-fea7bd69ee85 tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda" returned: 0 in 1.557s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5ea0821e-44de-44f0-a3c5-fea7bd69ee85 tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:18 devstack sudo[87509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317 Apr 16 23:01:18 devstack sudo[87509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:18 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7d426707-99e2-4e05-86e1-92bef8470e0c 1073741824" returned: 0 in 1.329s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7d426707-99e2-4e05-86e1-92bef8470e0c {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:18 devstack sudo[87512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7d426707-99e2-4e05-86e1-92bef8470e0c Apr 16 23:01:18 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:18 devstack sudo[87501]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6fc64014-e51c-4b6f-8cea-fa13d2536390 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-87c25ed0-c4cb-4632-977a-40fa27c47651" returned: 0 in 0.691s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:18 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6fc64014-e51c-4b6f-8cea-fa13d2536390 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "cinder-quobyte-87c25ed0-c4cb-4632-977a-40fa27c47651" released by "delete_volume" :: held 2.190s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:18 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-6fc64014-e51c-4b6f-8cea-fa13d2536390 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Created reservations ['0340c9e7-05e5-4750-ac31-034dfc9600cc', '2ba1acab-7987-4f35-99a6-f6572f2d7ecf', '6cd5d12d-801b-47ed-919c-7ef3507119ce', '9b2dff79-236c-44c4-8111-5d7ffb78b585'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:01:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6fc64014-e51c-4b6f-8cea-fa13d2536390 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6fc64014-e51c-4b6f-8cea-fa13d2536390 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:18 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-6fc64014-e51c-4b6f-8cea-fa13d2536390 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:18 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-6fc64014-e51c-4b6f-8cea-fa13d2536390 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6fc64014-e51c-4b6f-8cea-fa13d2536390 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6fc64014-e51c-4b6f-8cea-fa13d2536390 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:18 devstack sudo[87518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:01:18 devstack sudo[87518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:19 devstack sudo[87509]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5ea0821e-44de-44f0-a3c5-fea7bd69ee85 tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317" returned: 0 in 0.979s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5ea0821e-44de-44f0-a3c5-fea7bd69ee85 tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:19 devstack sudo[87520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317 Apr 16 23:01:19 devstack sudo[87520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:19 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7d426707-99e2-4e05-86e1-92bef8470e0c" returned: 0 in 1.246s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] <== create_volume: return (2642ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:01:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.651s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18937489-704f-4ffa-b768-db35738bc30c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d426707-99e2-4e05-86e1-92bef8470e0c', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc7bfbe-55a4-402e-bbe2-822b0d997fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:19 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Volume volume-7d426707-99e2-4e05-86e1-92bef8470e0c (7d426707-99e2-4e05-86e1-92bef8470e0c): created successfully Apr 16 23:01:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fc7bfbe-55a4-402e-bbe2-822b0d997fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Flow 'volume_create_manager' (0fa522fa-cc14-489f-a493-53e14eed6a08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:01:19 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-c81a2ae2-1d94-461d-a5f3-b4237fe75916 tempest-VolumeQuotasAdminTestJSON-1197476318 None] Created volume successfully. Apr 16 23:01:19 devstack sudo[87518]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6fc64014-e51c-4b6f-8cea-fa13d2536390 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.980s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:19 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-6fc64014-e51c-4b6f-8cea-fa13d2536390 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:01:19 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-6fc64014-e51c-4b6f-8cea-fa13d2536390 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Deleted volume successfully. Apr 16 23:01:19 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6fc64014-e51c-4b6f-8cea-fa13d2536390 tempest-CreateVolumesFromSourceVolumeTest-156396490 None] Lock "cinder-87c25ed0-c4cb-4632-977a-40fa27c47651-delete_volume" released by "delete_volume" :: held 3.551s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:19 devstack sudo[87520]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5ea0821e-44de-44f0-a3c5-fea7bd69ee85 tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda.9c01298d-5b2c-4fbf-af99-f70b5f0ff317" returned: 0 in 0.808s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:19 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5ea0821e-44de-44f0-a3c5-fea7bd69ee85 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "cinder-quobyte-9c01298d-5b2c-4fbf-af99-f70b5f0ff317" released by "_delete_snapshot" :: held 4.310s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:19 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5ea0821e-44de-44f0-a3c5-fea7bd69ee85 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "cinder-quobyte-11745c7e-4509-45b4-b845-96c95137ecda" released by "delete_snapshot" :: held 4.326s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:20 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-5ea0821e-44de-44f0-a3c5-fea7bd69ee85 tempest-VolumesSnapshotListTestJSON-1064752421 None] Created reservations ['9d6233b2-2ac8-49a3-a6bc-49040347841b', '9806ef0d-6b49-4c7a-9ec5-d06eb271cf88', '218ff1dd-b378-40c4-8d17-6d248ee93382', '176103d1-d791-4117-abc0-fcd03efd32c4'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:01:20 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-5ea0821e-44de-44f0-a3c5-fea7bd69ee85 tempest-VolumesSnapshotListTestJSON-1064752421 None] Delete snapshot completed successfully. Apr 16 23:01:20 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5ea0821e-44de-44f0-a3c5-fea7bd69ee85 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "cinder-9c01298d-5b2c-4fbf-af99-f70b5f0ff317-delete_snapshot" released by "delete_snapshot" :: held 4.482s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:20 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-322b7467-14c0-4174-bfdc-05c7165a148b tempest-VolumeQuotasAdminTestJSON-305088023 None] Transfer volume completed successfully. Apr 16 23:01:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-37857958-353f-4cc0-90fa-3e43683e1fe9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Acquiring lock "cinder-11745c7e-4509-45b4-b845-96c95137ecda-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-37857958-353f-4cc0-90fa-3e43683e1fe9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "cinder-11745c7e-4509-45b4-b845-96c95137ecda-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-37857958-353f-4cc0-90fa-3e43683e1fe9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Acquiring lock "cinder-quobyte-11745c7e-4509-45b4-b845-96c95137ecda" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-37857958-353f-4cc0-90fa-3e43683e1fe9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "cinder-quobyte-11745c7e-4509-45b4-b845-96c95137ecda" acquired by "delete_volume" :: waited 0.020s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:21 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[a942ce35-997d-4fb5-a5bd-3057cd72edbd]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-37857958-353f-4cc0-90fa-3e43683e1fe9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:21 devstack sudo[87526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda Apr 16 23:01:21 devstack sudo[87526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5e62bb03-951f-4907-bfec-42df857c46a4 tempest-VolumeQuotasAdminTestJSON-1980697334 None] Acquiring lock "cinder-7d426707-99e2-4e05-86e1-92bef8470e0c-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5e62bb03-951f-4907-bfec-42df857c46a4 tempest-VolumeQuotasAdminTestJSON-1980697334 None] Lock "cinder-7d426707-99e2-4e05-86e1-92bef8470e0c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5e62bb03-951f-4907-bfec-42df857c46a4 tempest-VolumeQuotasAdminTestJSON-1980697334 None] Acquiring lock "cinder-quobyte-7d426707-99e2-4e05-86e1-92bef8470e0c" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5e62bb03-951f-4907-bfec-42df857c46a4 tempest-VolumeQuotasAdminTestJSON-1980697334 None] Lock "cinder-quobyte-7d426707-99e2-4e05-86e1-92bef8470e0c" acquired by "delete_volume" :: waited 0.018s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:22 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f3a193-1029-4ef5-a804-3ea1cd4ebbec]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5e62bb03-951f-4907-bfec-42df857c46a4 tempest-VolumeQuotasAdminTestJSON-1980697334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7d426707-99e2-4e05-86e1-92bef8470e0c {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:22 devstack sudo[87529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7d426707-99e2-4e05-86e1-92bef8470e0c Apr 16 23:01:22 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:22 devstack sudo[87526]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-37857958-353f-4cc0-90fa-3e43683e1fe9 tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda" returned: 0 in 1.110s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-37857958-353f-4cc0-90fa-3e43683e1fe9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:22 devstack sudo[87535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda Apr 16 23:01:22 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:22 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:01:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Flow 'volume_create_manager' (43246787-bab6-4d6d-91b3-55170e6ecc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:01:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39c16dac-39d1-4bea-ab73-bd4d38e29756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39c16dac-39d1-4bea-ab73-bd4d38e29756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf9ae21-e04b-49fd-8780-5a061b9e3261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae56fdc8fc97419c97399f86252518ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:01:23Z,use_quota=True,user_id='e08e5b7d498a458bb8ba83c2ca928a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6686e3-ee78-4398-9777-1508dc5dcbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6686e3-ee78-4398-9777-1508dc5dcbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc12b5e-44cf-43f1-80f2-57b06939f81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc12b5e-44cf-43f1-80f2-57b06939f81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bf9ae21-e04b-49fd-8780-5a061b9e3261', 'volume_name': 'volume-3bf9ae21-e04b-49fd-8780-5a061b9e3261', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a268c8-d9fd-40de-ad80-848b441276d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60a268c8-d9fd-40de-ad80-848b441276d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:23 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e069ed-bcdd-4d60-909d-2c5ac8f452ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:23 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Volume 3bf9ae21-e04b-49fd-8780-5a061b9e3261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bf9ae21-e04b-49fd-8780-5a061b9e3261', 'volume_size': 1} Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf9ae21-e04b-49fd-8780-5a061b9e3261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae56fdc8fc97419c97399f86252518ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:01:23Z,use_quota=True,user_id='e08e5b7d498a458bb8ba83c2ca928a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Creating volume 3bf9ae21-e04b-49fd-8780-5a061b9e3261 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:01:23 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3bf9ae21-e04b-49fd-8780-5a061b9e3261 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-37857958-353f-4cc0-90fa-3e43683e1fe9 tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-11745c7e-4509-45b4-b845-96c95137ecda" returned: 0 in 0.764s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:23 devstack sudo[87571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3bf9ae21-e04b-49fd-8780-5a061b9e3261 1073741824 Apr 16 23:01:23 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-37857958-353f-4cc0-90fa-3e43683e1fe9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "cinder-quobyte-11745c7e-4509-45b4-b845-96c95137ecda" released by "delete_volume" :: held 1.980s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:23 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-37857958-353f-4cc0-90fa-3e43683e1fe9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Created reservations ['938d0d0b-16bb-4028-8bb6-2ecdbec4b61b', '3db5b030-343a-4b7c-a638-866f760d3c90', 'd5b841dd-63f1-4c6c-a3ee-4bc38c8de725', 'c58c158a-7862-4540-917a-50d3edf75775'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5e62bb03-951f-4907-bfec-42df857c46a4 tempest-VolumeQuotasAdminTestJSON-1980697334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7d426707-99e2-4e05-86e1-92bef8470e0c" returned: 0 in 1.280s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5e62bb03-951f-4907-bfec-42df857c46a4 tempest-VolumeQuotasAdminTestJSON-1980697334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7d426707-99e2-4e05-86e1-92bef8470e0c {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-37857958-353f-4cc0-90fa-3e43683e1fe9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-37857958-353f-4cc0-90fa-3e43683e1fe9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-37857958-353f-4cc0-90fa-3e43683e1fe9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-37857958-353f-4cc0-90fa-3e43683e1fe9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-37857958-353f-4cc0-90fa-3e43683e1fe9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-37857958-353f-4cc0-90fa-3e43683e1fe9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:23 devstack sudo[87574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7d426707-99e2-4e05-86e1-92bef8470e0c Apr 16 23:01:23 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:23 devstack sudo[87576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:01:23 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:24 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3bf9ae21-e04b-49fd-8780-5a061b9e3261 1073741824" returned: 0 in 1.062s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3bf9ae21-e04b-49fd-8780-5a061b9e3261 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:24 devstack sudo[87615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3bf9ae21-e04b-49fd-8780-5a061b9e3261 Apr 16 23:01:24 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:24 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5e62bb03-951f-4907-bfec-42df857c46a4 tempest-VolumeQuotasAdminTestJSON-1980697334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7d426707-99e2-4e05-86e1-92bef8470e0c" returned: 0 in 1.388s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:24 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5e62bb03-951f-4907-bfec-42df857c46a4 tempest-VolumeQuotasAdminTestJSON-1980697334 None] Lock "cinder-quobyte-7d426707-99e2-4e05-86e1-92bef8470e0c" released by "delete_volume" :: held 2.732s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:24 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:24 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-5e62bb03-951f-4907-bfec-42df857c46a4 tempest-VolumeQuotasAdminTestJSON-1980697334 None] Created reservations ['a80b21cc-9c08-4138-a0b8-30969c707bd0', '19ee7ee4-347d-439f-992a-05a406045770', '4e40c684-d76b-41a9-80bb-9cc720eebba7', '39b762a2-82de-4559-bfa8-1dcb7a236c50'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:01:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-37857958-353f-4cc0-90fa-3e43683e1fe9 tempest-VolumesSnapshotListTestJSON-1064752421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 1.531s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:24 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-37857958-353f-4cc0-90fa-3e43683e1fe9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:01:24 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-37857958-353f-4cc0-90fa-3e43683e1fe9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Deleted volume successfully. Apr 16 23:01:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5e62bb03-951f-4907-bfec-42df857c46a4 tempest-VolumeQuotasAdminTestJSON-1980697334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5e62bb03-951f-4907-bfec-42df857c46a4 tempest-VolumeQuotasAdminTestJSON-1980697334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:24 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5e62bb03-951f-4907-bfec-42df857c46a4 tempest-VolumeQuotasAdminTestJSON-1980697334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:24 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5e62bb03-951f-4907-bfec-42df857c46a4 tempest-VolumeQuotasAdminTestJSON-1980697334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5e62bb03-951f-4907-bfec-42df857c46a4 tempest-VolumeQuotasAdminTestJSON-1980697334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5e62bb03-951f-4907-bfec-42df857c46a4 tempest-VolumeQuotasAdminTestJSON-1980697334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:25 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-37857958-353f-4cc0-90fa-3e43683e1fe9 tempest-VolumesSnapshotListTestJSON-1064752421 None] Lock "cinder-11745c7e-4509-45b4-b845-96c95137ecda-delete_volume" released by "delete_volume" :: held 3.944s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:25 devstack sudo[87619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:01:25 devstack sudo[87619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:25 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3bf9ae21-e04b-49fd-8780-5a061b9e3261" returned: 0 in 1.533s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:25 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] <== create_volume: return (2708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:01:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.715s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96e069ed-bcdd-4d60-909d-2c5ac8f452ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bf9ae21-e04b-49fd-8780-5a061b9e3261', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7ebc27-b25c-4c1e-a3a2-335d453ecb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:25 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4a611701-ddd2-4eff-88b4-c6c562f9f42c tempest-ServerRescueNegativeTestJSON-1049192490 None] Acquiring lock "cinder-240b8813-d108-4d0e-8cff-1de7b40fa2d1-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:25 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Volume volume-3bf9ae21-e04b-49fd-8780-5a061b9e3261 (3bf9ae21-e04b-49fd-8780-5a061b9e3261): created successfully Apr 16 23:01:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a7ebc27-b25c-4c1e-a3a2-335d453ecb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Flow 'volume_create_manager' (43246787-bab6-4d6d-91b3-55170e6ecc62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:01:25 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-db7e480a-e4b7-48bb-8d3b-64212a1dcaae tempest-CinderUnicodeTest-2012802668 None] Created volume successfully. Apr 16 23:01:25 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4a611701-ddd2-4eff-88b4-c6c562f9f42c tempest-ServerRescueNegativeTestJSON-1049192490 None] Lock "cinder-240b8813-d108-4d0e-8cff-1de7b40fa2d1-delete_volume" acquired by "delete_volume" :: waited 0.139s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4a611701-ddd2-4eff-88b4-c6c562f9f42c tempest-ServerRescueNegativeTestJSON-1049192490 None] Acquiring lock "cinder-quobyte-240b8813-d108-4d0e-8cff-1de7b40fa2d1" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4a611701-ddd2-4eff-88b4-c6c562f9f42c tempest-ServerRescueNegativeTestJSON-1049192490 None] Lock "cinder-quobyte-240b8813-d108-4d0e-8cff-1de7b40fa2d1" acquired by "delete_volume" :: waited 0.014s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:26 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7736b5-479f-4d93-9aee-c8b8071afc40]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4a611701-ddd2-4eff-88b4-c6c562f9f42c tempest-ServerRescueNegativeTestJSON-1049192490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-240b8813-d108-4d0e-8cff-1de7b40fa2d1 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:26 devstack sudo[87619]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5e62bb03-951f-4907-bfec-42df857c46a4 tempest-VolumeQuotasAdminTestJSON-1980697334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 1.292s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:26 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-5e62bb03-951f-4907-bfec-42df857c46a4 tempest-VolumeQuotasAdminTestJSON-1980697334 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:01:26 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-5e62bb03-951f-4907-bfec-42df857c46a4 tempest-VolumeQuotasAdminTestJSON-1980697334 None] Deleted volume successfully. Apr 16 23:01:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5e62bb03-951f-4907-bfec-42df857c46a4 tempest-VolumeQuotasAdminTestJSON-1980697334 None] Lock "cinder-7d426707-99e2-4e05-86e1-92bef8470e0c-delete_volume" released by "delete_volume" :: held 4.469s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:26 devstack sudo[87624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-240b8813-d108-4d0e-8cff-1de7b40fa2d1 Apr 16 23:01:26 devstack sudo[87624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:27 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:01:27 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Flow 'volume_create_manager' (bbb8eafe-d361-4d56-b5ca-a415075a6454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:01:27 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d5ec7d-1448-46ad-a7d6-fb74e16ca6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:27 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d5ec7d-1448-46ad-a7d6-fb74e16ca6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:01:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2005848714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308fe409-187a-4180-bfc9-e61a2932ec8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae56fdc8fc97419c97399f86252518ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:01:27Z,use_quota=True,user_id='e08e5b7d498a458bb8ba83c2ca928a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:27 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b2afdd5-5e0e-47fe-9e58-1bedec6eb36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:27 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b2afdd5-5e0e-47fe-9e58-1bedec6eb36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:27 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1941f993-e810-4dca-86d1-193898677594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:27 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1941f993-e810-4dca-86d1-193898677594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '308fe409-187a-4180-bfc9-e61a2932ec8d', 'volume_name': 'volume-308fe409-187a-4180-bfc9-e61a2932ec8d', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:27 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9077e2ac-6f6c-4e7e-a068-fbfe6425084d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:27 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9077e2ac-6f6c-4e7e-a068-fbfe6425084d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:27 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e72fce-2585-4399-9af0-49c289141698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:27 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Volume 308fe409-187a-4180-bfc9-e61a2932ec8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-308fe409-187a-4180-bfc9-e61a2932ec8d', 'volume_size': 1} Apr 16 23:01:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:27 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:01:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2005848714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=308fe409-187a-4180-bfc9-e61a2932ec8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae56fdc8fc97419c97399f86252518ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:01:27Z,use_quota=True,user_id='e08e5b7d498a458bb8ba83c2ca928a80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:01:27 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Creating volume 308fe409-187a-4180-bfc9-e61a2932ec8d {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:01:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:27 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:27 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:27 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:01:27 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:01:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:27 devstack sudo[87629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d 1073741824 Apr 16 23:01:27 devstack sudo[87629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:27 devstack sudo[87624]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4a611701-ddd2-4eff-88b4-c6c562f9f42c tempest-ServerRescueNegativeTestJSON-1049192490 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-240b8813-d108-4d0e-8cff-1de7b40fa2d1" returned: 0 in 1.349s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4a611701-ddd2-4eff-88b4-c6c562f9f42c tempest-ServerRescueNegativeTestJSON-1049192490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-240b8813-d108-4d0e-8cff-1de7b40fa2d1 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:27 devstack sudo[87632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-240b8813-d108-4d0e-8cff-1de7b40fa2d1 Apr 16 23:01:27 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:28 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:01:28 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Flow 'volume_create_manager' (95ac75e6-220f-401b-bcf2-29fc3bd3041f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:01:28 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95224c45-3bd9-4b4d-89af-f85dae04ba00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:28 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95224c45-3bd9-4b4d-89af-f85dae04ba00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1181618395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3487c8d-de1d-4618-97bc-bd2566db7415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a6310f1a5c4fa28074d480bce3e62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:01:28Z,use_quota=True,user_id='6a02a7c54c0e4035b6eb2b1f0774db77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:28 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1440ff3-e56a-47d6-ba63-a196a9c2f0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:28 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1440ff3-e56a-47d6-ba63-a196a9c2f0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:28 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62b352b-14a1-47c1-93bc-dff476e29bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:28 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b62b352b-14a1-47c1-93bc-dff476e29bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3487c8d-de1d-4618-97bc-bd2566db7415', 'volume_name': 'volume-e3487c8d-de1d-4618-97bc-bd2566db7415', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:28 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418c0bd2-9fd3-4891-9abb-09ad62623e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:28 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418c0bd2-9fd3-4891-9abb-09ad62623e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:28 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b8b461-0066-4151-922b-ef19290e1027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:28 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Volume e3487c8d-de1d-4618-97bc-bd2566db7415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3487c8d-de1d-4618-97bc-bd2566db7415', 'volume_size': 1} Apr 16 23:01:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:28 devstack sudo[87629]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d 1073741824" returned: 0 in 1.386s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:28 devstack sudo[87639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d Apr 16 23:01:28 devstack sudo[87639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:28 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4a611701-ddd2-4eff-88b4-c6c562f9f42c tempest-ServerRescueNegativeTestJSON-1049192490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-240b8813-d108-4d0e-8cff-1de7b40fa2d1" returned: 0 in 1.301s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:28 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4a611701-ddd2-4eff-88b4-c6c562f9f42c tempest-ServerRescueNegativeTestJSON-1049192490 None] Lock "cinder-quobyte-240b8813-d108-4d0e-8cff-1de7b40fa2d1" released by "delete_volume" :: held 2.771s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:28 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:01:28 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Flow 'volume_create_manager' (63a61729-59b9-4d65-9d4a-158a5939722f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:01:28 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f71530-3640-4c7d-8c2c-bc5535e4b766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79f71530-3640-4c7d-8c2c-bc5535e4b766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1703507015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7301d839-14e9-4fa6-a296-a5e0b1214f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a6310f1a5c4fa28074d480bce3e62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:01:29Z,use_quota=True,user_id='6a02a7c54c0e4035b6eb2b1f0774db77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70adb4b5-9759-4ce8-89d7-909939bb8bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70adb4b5-9759-4ce8-89d7-909939bb8bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3ac32e-b0ae-4221-80d9-ff0df24a0a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3ac32e-b0ae-4221-80d9-ff0df24a0a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7301d839-14e9-4fa6-a296-a5e0b1214f0e', 'volume_name': 'volume-7301d839-14e9-4fa6-a296-a5e0b1214f0e', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f616eb8-d918-432e-8ad3-2839072623fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f616eb8-d918-432e-8ad3-2839072623fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e768b83-6a9f-4356-ab97-c3044c1dc34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:29 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Volume 7301d839-14e9-4fa6-a296-a5e0b1214f0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7301d839-14e9-4fa6-a296-a5e0b1214f0e', 'volume_size': 1} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-4a611701-ddd2-4eff-88b4-c6c562f9f42c tempest-ServerRescueNegativeTestJSON-1049192490 None] Created reservations ['9be51cad-3232-431d-8b2a-f44b291abf6a', '4422abd3-4fd9-4a9e-b81a-f674159a8955', '4b05fc66-699a-4720-b4cc-14edef0dd4ab', '39ebeafe-2d8a-4c3e-96d0-45f299f38e9f'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Flow 'volume_create_manager' (d7b60384-f17c-489a-91fc-f590bbafe32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d354f4-e325-47e9-be5d-f2c3d61521ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d354f4-e325-47e9-be5d-f2c3d61521ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1125864332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a6310f1a5c4fa28074d480bce3e62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:01:29Z,use_quota=True,user_id='6a02a7c54c0e4035b6eb2b1f0774db77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d371cddf-e8ce-4a56-9fae-717f0bff68c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d371cddf-e8ce-4a56-9fae-717f0bff68c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1626d51c-aeef-48d9-8e65-2e859bbe4f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1626d51c-aeef-48d9-8e65-2e859bbe4f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69', 'volume_name': 'volume-5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad70ed79-a12a-4452-aa1e-500505d85e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad70ed79-a12a-4452-aa1e-500505d85e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f483079d-e0c6-4f63-8eac-04289e606412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:29 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Volume 5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69', 'volume_size': 1} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-4a611701-ddd2-4eff-88b4-c6c562f9f42c tempest-ServerRescueNegativeTestJSON-1049192490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-4a611701-ddd2-4eff-88b4-c6c562f9f42c tempest-ServerRescueNegativeTestJSON-1049192490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-4a611701-ddd2-4eff-88b4-c6c562f9f42c tempest-ServerRescueNegativeTestJSON-1049192490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-4a611701-ddd2-4eff-88b4-c6c562f9f42c tempest-ServerRescueNegativeTestJSON-1049192490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-4a611701-ddd2-4eff-88b4-c6c562f9f42c tempest-ServerRescueNegativeTestJSON-1049192490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4a611701-ddd2-4eff-88b4-c6c562f9f42c tempest-ServerRescueNegativeTestJSON-1049192490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:29 devstack sudo[87641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:01:29 devstack sudo[87641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Flow 'volume_create_manager' (567b2608-c87c-4d95-bbe0-c687e3c83a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f9e70a-f949-4b28-a7ae-802475a2f5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f9e70a-f949-4b28-a7ae-802475a2f5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1996861971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25999d2-2318-46bb-9549-e19733462007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a6310f1a5c4fa28074d480bce3e62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:01:30Z,use_quota=True,user_id='6a02a7c54c0e4035b6eb2b1f0774db77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9138c24c-c6db-40f1-a3c4-5bf6e88a7784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9138c24c-c6db-40f1-a3c4-5bf6e88a7784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46a9f21-5438-4fa8-9961-56e3af49fd8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46a9f21-5438-4fa8-9961-56e3af49fd8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e25999d2-2318-46bb-9549-e19733462007', 'volume_name': 'volume-e25999d2-2318-46bb-9549-e19733462007', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09dd1d4d-48fa-4352-8ea8-67493de2c89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09dd1d4d-48fa-4352-8ea8-67493de2c89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d399902-33a2-417d-a81c-fa080c479887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:29 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Volume e25999d2-2318-46bb-9549-e19733462007: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e25999d2-2318-46bb-9549-e19733462007', 'volume_size': 1} Apr 16 23:01:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Flow 'volume_create_manager' (312e6d75-ade0-4e57-b813-28c8872dcaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da43602e-7eed-4ae8-a973-312cee3527f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da43602e-7eed-4ae8-a973-312cee3527f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-192678023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f38b7c-9b24-4795-818f-dfc62be4ee64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a6310f1a5c4fa28074d480bce3e62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:01:30Z,use_quota=True,user_id='6a02a7c54c0e4035b6eb2b1f0774db77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d668f66-0a0d-4f51-996b-82a7b707893d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d668f66-0a0d-4f51-996b-82a7b707893d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e536c5df-245c-415b-9832-7f207654e15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e536c5df-245c-415b-9832-7f207654e15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6f38b7c-9b24-4795-818f-dfc62be4ee64', 'volume_name': 'volume-e6f38b7c-9b24-4795-818f-dfc62be4ee64', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39546e58-8ff8-4a5d-9cd2-d769a403f195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39546e58-8ff8-4a5d-9cd2-d769a403f195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd60dad6-cee7-497b-84b1-d902115ffc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:30 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Volume e6f38b7c-9b24-4795-818f-dfc62be4ee64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6f38b7c-9b24-4795-818f-dfc62be4ee64', 'volume_size': 1} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:30 devstack sudo[87639]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d" returned: 0 in 1.622s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] <== create_volume: return (3067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.076s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.674s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1181618395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3487c8d-de1d-4618-97bc-bd2566db7415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a6310f1a5c4fa28074d480bce3e62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:01:28Z,use_quota=True,user_id='6a02a7c54c0e4035b6eb2b1f0774db77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Creating volume e3487c8d-de1d-4618-97bc-bd2566db7415 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:01:30 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e3487c8d-de1d-4618-97bc-bd2566db7415 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e72fce-2585-4399-9af0-49c289141698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-308fe409-187a-4180-bfc9-e61a2932ec8d', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7549f9a1-4427-4cf7-8543-10427e28abc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:30 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Volume volume-308fe409-187a-4180-bfc9-e61a2932ec8d (308fe409-187a-4180-bfc9-e61a2932ec8d): created successfully Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7549f9a1-4427-4cf7-8543-10427e28abc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Flow 'volume_create_manager' (bbb8eafe-d361-4d56-b5ca-a415075a6454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:01:30 devstack sudo[87645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e3487c8d-de1d-4618-97bc-bd2566db7415 1073741824 Apr 16 23:01:30 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:30 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-32c5a118-e1aa-4a5c-8572-1257f1592d3a tempest-CinderUnicodeTest-2012802668 None] Created volume successfully. Apr 16 23:01:30 devstack sudo[87641]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4a611701-ddd2-4eff-88b4-c6c562f9f42c tempest-ServerRescueNegativeTestJSON-1049192490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 1.083s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-4a611701-ddd2-4eff-88b4-c6c562f9f42c tempest-ServerRescueNegativeTestJSON-1049192490 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:01:30 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-4a611701-ddd2-4eff-88b4-c6c562f9f42c tempest-ServerRescueNegativeTestJSON-1049192490 None] Deleted volume successfully. Apr 16 23:01:30 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4a611701-ddd2-4eff-88b4-c6c562f9f42c tempest-ServerRescueNegativeTestJSON-1049192490 None] Lock "cinder-240b8813-d108-4d0e-8cff-1de7b40fa2d1-delete_volume" released by "delete_volume" :: held 4.614s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:31 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e3487c8d-de1d-4618-97bc-bd2566db7415 1073741824" returned: 0 in 0.958s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e3487c8d-de1d-4618-97bc-bd2566db7415 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:31 devstack sudo[87651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e3487c8d-de1d-4618-97bc-bd2566db7415 Apr 16 23:01:31 devstack sudo[87651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-4b788a23-afcc-4726-91a8-79942d2c6544 tempest-CinderUnicodeTest-2012802668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:31 devstack sudo[87651]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e3487c8d-de1d-4618-97bc-bd2566db7415" returned: 0 in 0.669s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:31 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:01:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.872s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:31 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1703507015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7301d839-14e9-4fa6-a296-a5e0b1214f0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a6310f1a5c4fa28074d480bce3e62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:01:29Z,use_quota=True,user_id='6a02a7c54c0e4035b6eb2b1f0774db77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:01:31 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Creating volume 7301d839-14e9-4fa6-a296-a5e0b1214f0e {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:01:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:32 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:32 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:32 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:01:32 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:01:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7301d839-14e9-4fa6-a296-a5e0b1214f0e 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b8b461-0066-4151-922b-ef19290e1027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3487c8d-de1d-4618-97bc-bd2566db7415', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85299baa-4d8c-4042-9fd6-558c651e9104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:32 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Volume volume-e3487c8d-de1d-4618-97bc-bd2566db7415 (e3487c8d-de1d-4618-97bc-bd2566db7415): created successfully Apr 16 23:01:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85299baa-4d8c-4042-9fd6-558c651e9104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:32 devstack sudo[87681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7301d839-14e9-4fa6-a296-a5e0b1214f0e 1073741824 Apr 16 23:01:32 devstack sudo[87681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Flow 'volume_create_manager' (95ac75e6-220f-401b-bcf2-29fc3bd3041f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:01:32 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-bfe650e4-ebd8-4c9c-bba7-c735939567d0 tempest-CreateVolumesFromImageTest-1295912401 None] Created volume successfully. Apr 16 23:01:32 devstack sudo[87681]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7301d839-14e9-4fa6-a296-a5e0b1214f0e 1073741824" returned: 0 in 0.887s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7301d839-14e9-4fa6-a296-a5e0b1214f0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:32 devstack sudo[87688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7301d839-14e9-4fa6-a296-a5e0b1214f0e Apr 16 23:01:32 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:33 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7301d839-14e9-4fa6-a296-a5e0b1214f0e" returned: 0 in 0.652s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:01:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.111s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1125864332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a6310f1a5c4fa28074d480bce3e62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:01:29Z,use_quota=True,user_id='6a02a7c54c0e4035b6eb2b1f0774db77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:01:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Creating volume 5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:01:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:01:33 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:01:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e768b83-6a9f-4356-ab97-c3044c1dc34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7301d839-14e9-4fa6-a296-a5e0b1214f0e', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e55e56f-b365-439e-837d-711f15b85e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:33 devstack sudo[87692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69 1073741824 Apr 16 23:01:33 devstack sudo[87692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:33 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Volume volume-7301d839-14e9-4fa6-a296-a5e0b1214f0e (7301d839-14e9-4fa6-a296-a5e0b1214f0e): created successfully Apr 16 23:01:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e55e56f-b365-439e-837d-711f15b85e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Flow 'volume_create_manager' (63a61729-59b9-4d65-9d4a-158a5939722f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:01:33 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-ed8628ca-f946-4681-b444-25a84996f881 tempest-CreateVolumesFromImageTest-1295912401 None] Created volume successfully. Apr 16 23:01:34 devstack sudo[87692]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69 1073741824" returned: 0 in 0.881s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:34 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:01:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Flow 'volume_create_manager' (21d4a4a8-5514-48b7-a274-2c79ab4a3ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:01:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df50825-6d1f-45fb-9637-8742f1f7fc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7df50825-6d1f-45fb-9637-8742f1f7fc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-150429131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71dbeafd-8c43-4b73-ab4e-26aa88243c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='104c6379fc30489e867a674f13de9869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:01:34Z,use_quota=True,user_id='35a0b21d292e44ed9e2fe22d60db5bbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b9249f0-06ab-45ae-87a6-9d1a5525730d),volume_type_id=1b9249f0-06ab-45ae-87a6-9d1a5525730d)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a89549d-450f-46dd-861b-fd52453963e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a89549d-450f-46dd-861b-fd52453963e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43a4333-57a8-403d-a43b-5937597e7ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e43a4333-57a8-403d-a43b-5937597e7ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71dbeafd-8c43-4b73-ab4e-26aa88243c91', 'volume_name': 'volume-71dbeafd-8c43-4b73-ab4e-26aa88243c91', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2aeec4-07d2-4212-9418-8e00ecd67b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b2aeec4-07d2-4212-9418-8e00ecd67b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3825b0e4-0408-4e42-b038-ddc0fb9dab0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:34 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Volume 71dbeafd-8c43-4b73-ab4e-26aa88243c91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71dbeafd-8c43-4b73-ab4e-26aa88243c91', 'volume_size': 1} Apr 16 23:01:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:34 devstack sudo[87698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69 Apr 16 23:01:34 devstack sudo[87698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:35 devstack sudo[87698]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69" returned: 0 in 0.680s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:01:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.541s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1996861971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25999d2-2318-46bb-9549-e19733462007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a6310f1a5c4fa28074d480bce3e62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:01:30Z,use_quota=True,user_id='6a02a7c54c0e4035b6eb2b1f0774db77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:01:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Creating volume e25999d2-2318-46bb-9549-e19733462007 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:01:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:01:35 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:01:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e25999d2-2318-46bb-9549-e19733462007 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:35 devstack sudo[87701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e25999d2-2318-46bb-9549-e19733462007 1073741824 Apr 16 23:01:35 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f483079d-e0c6-4f63-8eac-04289e606412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa852e0f-d335-495f-9ca3-24697a59420b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:35 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Volume volume-5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69 (5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69): created successfully Apr 16 23:01:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa852e0f-d335-495f-9ca3-24697a59420b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Flow 'volume_create_manager' (d7b60384-f17c-489a-91fc-f590bbafe32d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:01:35 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-8ef83ef8-9fd5-44a2-b95f-fec8c5d7e19b tempest-CreateVolumesFromImageTest-1295912401 None] Created volume successfully. Apr 16 23:01:35 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e25999d2-2318-46bb-9549-e19733462007 1073741824" returned: 0 in 0.619s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e25999d2-2318-46bb-9549-e19733462007 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:36 devstack sudo[87706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e25999d2-2318-46bb-9549-e19733462007 Apr 16 23:01:36 devstack sudo[87706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:36 devstack sudo[87706]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e25999d2-2318-46bb-9549-e19733462007" returned: 0 in 0.500s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:01:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.327s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-192678023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6f38b7c-9b24-4795-818f-dfc62be4ee64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2a6310f1a5c4fa28074d480bce3e62b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:01:30Z,use_quota=True,user_id='6a02a7c54c0e4035b6eb2b1f0774db77',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:01:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Creating volume e6f38b7c-9b24-4795-818f-dfc62be4ee64 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:01:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:01:36 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:01:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e6f38b7c-9b24-4795-818f-dfc62be4ee64 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d399902-33a2-417d-a81c-fa080c479887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e25999d2-2318-46bb-9549-e19733462007', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efdcf07-c6f4-4012-ae20-fdd44ccd66ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:36 devstack sudo[87709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e6f38b7c-9b24-4795-818f-dfc62be4ee64 1073741824 Apr 16 23:01:36 devstack sudo[87709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:36 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Volume volume-e25999d2-2318-46bb-9549-e19733462007 (e25999d2-2318-46bb-9549-e19733462007): created successfully Apr 16 23:01:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efdcf07-c6f4-4012-ae20-fdd44ccd66ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Flow 'volume_create_manager' (567b2608-c87c-4d95-bbe0-c687e3c83a98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:01:36 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-52642c19-d6e6-48ee-a346-1a08041b39fc tempest-CreateVolumesFromImageTest-1295912401 None] Created volume successfully. Apr 16 23:01:37 devstack sudo[87709]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e6f38b7c-9b24-4795-818f-dfc62be4ee64 1073741824" returned: 0 in 0.716s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e6f38b7c-9b24-4795-818f-dfc62be4ee64 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:37 devstack sudo[87714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e6f38b7c-9b24-4795-818f-dfc62be4ee64 Apr 16 23:01:37 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:37 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e6f38b7c-9b24-4795-818f-dfc62be4ee64" returned: 0 in 0.586s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:37 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:01:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-4b788a23-afcc-4726-91a8-79942d2c6544 tempest-CinderUnicodeTest-2012802668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.070s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd60dad6-cee7-497b-84b1-d902115ffc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6f38b7c-9b24-4795-818f-dfc62be4ee64', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8552b004-aea3-400b-9ea2-7ba54c1f12fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:37 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-4b788a23-afcc-4726-91a8-79942d2c6544 tempest-CinderUnicodeTest-2012802668 None] Creating offline snapshot 18fd8992-7ea2-4948-ad78-2fc3296efe3c of volume 308fe409-187a-4180-bfc9-e61a2932ec8d {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:01:37 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Volume volume-e6f38b7c-9b24-4795-818f-dfc62be4ee64 (e6f38b7c-9b24-4795-818f-dfc62be4ee64): created successfully Apr 16 23:01:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8552b004-aea3-400b-9ea2-7ba54c1f12fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Flow 'volume_create_manager' (312e6d75-ade0-4e57-b813-28c8872dcaf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:01:37 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[19816579-d385-4f21-91e9-737ac8fd367a]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4b788a23-afcc-4726-91a8-79942d2c6544 tempest-CinderUnicodeTest-2012802668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:37 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-d333887c-587f-47e7-9115-6916969c77c1 tempest-CreateVolumesFromImageTest-1295912401 None] Created volume successfully. Apr 16 23:01:38 devstack sudo[87718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d Apr 16 23:01:38 devstack sudo[87718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:38 devstack sudo[87718]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4b788a23-afcc-4726-91a8-79942d2c6544 tempest-CinderUnicodeTest-2012802668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d" returned: 0 in 0.659s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4b788a23-afcc-4726-91a8-79942d2c6544 tempest-CinderUnicodeTest-2012802668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.18fd8992-7ea2-4948-ad78-2fc3296efe3c 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:38 devstack sudo[87733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.18fd8992-7ea2-4948-ad78-2fc3296efe3c 1G Apr 16 23:01:38 devstack sudo[87733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:39 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3d59af63-9605-43d0-a30a-21bc2357be80 tempest-CreateVolumesFromImageTest-1295912401 None] Acquiring lock "cinder-e6f38b7c-9b24-4795-818f-dfc62be4ee64-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:39 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3d59af63-9605-43d0-a30a-21bc2357be80 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "cinder-e6f38b7c-9b24-4795-818f-dfc62be4ee64-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:39 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3d59af63-9605-43d0-a30a-21bc2357be80 tempest-CreateVolumesFromImageTest-1295912401 None] Acquiring lock "cinder-quobyte-e6f38b7c-9b24-4795-818f-dfc62be4ee64" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:39 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3d59af63-9605-43d0-a30a-21bc2357be80 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "cinder-quobyte-e6f38b7c-9b24-4795-818f-dfc62be4ee64" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:39 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[877097fe-13fa-4c8e-b24e-db73e1ef2e0c]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3d59af63-9605-43d0-a30a-21bc2357be80 tempest-CreateVolumesFromImageTest-1295912401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e6f38b7c-9b24-4795-818f-dfc62be4ee64 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:39 devstack sudo[87754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e6f38b7c-9b24-4795-818f-dfc62be4ee64 Apr 16 23:01:39 devstack sudo[87754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:39 devstack sudo[87733]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4b788a23-afcc-4726-91a8-79942d2c6544 tempest-CinderUnicodeTest-2012802668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.18fd8992-7ea2-4948-ad78-2fc3296efe3c 1G" returned: 0 in 0.631s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4b788a23-afcc-4726-91a8-79942d2c6544 tempest-CinderUnicodeTest-2012802668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-308fe409-187a-4180-bfc9-e61a2932ec8d -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.18fd8992-7ea2-4948-ad78-2fc3296efe3c {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:39 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-308fe409-187a-4180-bfc9-e61a2932ec8d -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.18fd8992-7ea2-4948-ad78-2fc3296efe3c Apr 16 23:01:39 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:39 devstack sudo[87754]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3d59af63-9605-43d0-a30a-21bc2357be80 tempest-CreateVolumesFromImageTest-1295912401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e6f38b7c-9b24-4795-818f-dfc62be4ee64" returned: 0 in 0.509s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3d59af63-9605-43d0-a30a-21bc2357be80 tempest-CreateVolumesFromImageTest-1295912401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e6f38b7c-9b24-4795-818f-dfc62be4ee64 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:39 devstack sudo[87764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e6f38b7c-9b24-4795-818f-dfc62be4ee64 Apr 16 23:01:39 devstack sudo[87764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:39 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4b788a23-afcc-4726-91a8-79942d2c6544 tempest-CinderUnicodeTest-2012802668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-308fe409-187a-4180-bfc9-e61a2932ec8d -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.18fd8992-7ea2-4948-ad78-2fc3296efe3c" returned: 0 in 0.463s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:39 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-4b788a23-afcc-4726-91a8-79942d2c6544 tempest-CinderUnicodeTest-2012802668 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.18fd8992-7ea2-4948-ad78-2fc3296efe3c is being set with open permissions: ugo+rw Apr 16 23:01:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4b788a23-afcc-4726-91a8-79942d2c6544 tempest-CinderUnicodeTest-2012802668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.18fd8992-7ea2-4948-ad78-2fc3296efe3c {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:39 devstack sudo[87767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.18fd8992-7ea2-4948-ad78-2fc3296efe3c Apr 16 23:01:39 devstack sudo[87767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:40 devstack sudo[87764]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3d59af63-9605-43d0-a30a-21bc2357be80 tempest-CreateVolumesFromImageTest-1295912401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e6f38b7c-9b24-4795-818f-dfc62be4ee64" returned: 0 in 0.582s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:40 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3d59af63-9605-43d0-a30a-21bc2357be80 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "cinder-quobyte-e6f38b7c-9b24-4795-818f-dfc62be4ee64" released by "delete_volume" :: held 1.118s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:40 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-3d59af63-9605-43d0-a30a-21bc2357be80 tempest-CreateVolumesFromImageTest-1295912401 None] Created reservations ['075df7ac-278b-4da8-b37c-a3e7cb4ab994', '9b72ae49-540e-4be4-bdfa-4941e2a3ccde', '2f2e467e-c80e-4616-b1c7-166375458705', '29c3ac0c-7c32-4b0a-b292-f907b8ab92a7'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:01:40 devstack sudo[87767]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4b788a23-afcc-4726-91a8-79942d2c6544 tempest-CinderUnicodeTest-2012802668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.18fd8992-7ea2-4948-ad78-2fc3296efe3c" returned: 0 in 0.569s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3d59af63-9605-43d0-a30a-21bc2357be80 tempest-CreateVolumesFromImageTest-1295912401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3d59af63-9605-43d0-a30a-21bc2357be80 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3d59af63-9605-43d0-a30a-21bc2357be80 tempest-CreateVolumesFromImageTest-1295912401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3d59af63-9605-43d0-a30a-21bc2357be80 tempest-CreateVolumesFromImageTest-1295912401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3d59af63-9605-43d0-a30a-21bc2357be80 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3d59af63-9605-43d0-a30a-21bc2357be80 tempest-CreateVolumesFromImageTest-1295912401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:40 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:01:40 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4b788a23-afcc-4726-91a8-79942d2c6544 tempest-CinderUnicodeTest-2012802668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:40 devstack sudo[87775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.info Apr 16 23:01:40 devstack sudo[87775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:40 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3d59af63-9605-43d0-a30a-21bc2357be80 tempest-CreateVolumesFromImageTest-1295912401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.436s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:40 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-3d59af63-9605-43d0-a30a-21bc2357be80 tempest-CreateVolumesFromImageTest-1295912401 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:01:40 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-3d59af63-9605-43d0-a30a-21bc2357be80 tempest-CreateVolumesFromImageTest-1295912401 None] Deleted volume successfully. Apr 16 23:01:40 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3d59af63-9605-43d0-a30a-21bc2357be80 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "cinder-e6f38b7c-9b24-4795-818f-dfc62be4ee64-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:40 devstack sudo[87775]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4b788a23-afcc-4726-91a8-79942d2c6544 tempest-CinderUnicodeTest-2012802668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.info" returned: 0 in 0.471s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:40 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-4b788a23-afcc-4726-91a8-79942d2c6544 tempest-CinderUnicodeTest-2012802668 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.info is being set with open permissions: ugo+rw Apr 16 23:01:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4b788a23-afcc-4726-91a8-79942d2c6544 tempest-CinderUnicodeTest-2012802668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:40 devstack sudo[87779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.info Apr 16 23:01:40 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:41 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5aa886a5-c417-43e8-8f2a-ec397ab10743 tempest-CreateVolumesFromImageTest-1295912401 None] Acquiring lock "cinder-e25999d2-2318-46bb-9549-e19733462007-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:41 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5aa886a5-c417-43e8-8f2a-ec397ab10743 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "cinder-e25999d2-2318-46bb-9549-e19733462007-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:41 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:41 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5aa886a5-c417-43e8-8f2a-ec397ab10743 tempest-CreateVolumesFromImageTest-1295912401 None] Acquiring lock "cinder-quobyte-e25999d2-2318-46bb-9549-e19733462007" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4b788a23-afcc-4726-91a8-79942d2c6544 tempest-CinderUnicodeTest-2012802668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.info" returned: 0 in 0.594s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-4b788a23-afcc-4726-91a8-79942d2c6544 tempest-CinderUnicodeTest-2012802668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.525s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.805s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:41 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-150429131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71dbeafd-8c43-4b73-ab4e-26aa88243c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='104c6379fc30489e867a674f13de9869',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:01:34Z,use_quota=True,user_id='35a0b21d292e44ed9e2fe22d60db5bbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1b9249f0-06ab-45ae-87a6-9d1a5525730d),volume_type_id=1b9249f0-06ab-45ae-87a6-9d1a5525730d)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:01:41 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Creating volume 71dbeafd-8c43-4b73-ab4e-26aa88243c91 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:01:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:41 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:41 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:41 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:01:41 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:01:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-71dbeafd-8c43-4b73-ab4e-26aa88243c91 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:41 devstack sudo[87782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-71dbeafd-8c43-4b73-ab4e-26aa88243c91 1073741824 Apr 16 23:01:41 devstack sudo[87782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:41 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5aa886a5-c417-43e8-8f2a-ec397ab10743 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "cinder-quobyte-e25999d2-2318-46bb-9549-e19733462007" acquired by "delete_volume" :: waited 0.077s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:41 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-4b788a23-afcc-4726-91a8-79942d2c6544 tempest-CinderUnicodeTest-2012802668 None] Create snapshot completed successfully Apr 16 23:01:41 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5e36a0-f87b-4e6c-833b-32be31016cd9]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5aa886a5-c417-43e8-8f2a-ec397ab10743 tempest-CreateVolumesFromImageTest-1295912401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e25999d2-2318-46bb-9549-e19733462007 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:41 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e25999d2-2318-46bb-9549-e19733462007 Apr 16 23:01:41 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:42 devstack sudo[87782]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:42 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-71dbeafd-8c43-4b73-ab4e-26aa88243c91 1073741824" returned: 0 in 0.673s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5aa886a5-c417-43e8-8f2a-ec397ab10743 tempest-CreateVolumesFromImageTest-1295912401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e25999d2-2318-46bb-9549-e19733462007" returned: 0 in 0.617s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5aa886a5-c417-43e8-8f2a-ec397ab10743 tempest-CreateVolumesFromImageTest-1295912401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e25999d2-2318-46bb-9549-e19733462007 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:42 devstack sudo[87793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e25999d2-2318-46bb-9549-e19733462007 Apr 16 23:01:42 devstack sudo[87793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-71dbeafd-8c43-4b73-ab4e-26aa88243c91 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:42 devstack sudo[87795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-71dbeafd-8c43-4b73-ab4e-26aa88243c91 Apr 16 23:01:42 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:42 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-297599c6-b126-4f57-939c-7f7b3100ddae tempest-CinderUnicodeTest-2012802668 None] Acquiring lock "cinder-18fd8992-7ea2-4948-ad78-2fc3296efe3c-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:42 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-297599c6-b126-4f57-939c-7f7b3100ddae tempest-CinderUnicodeTest-2012802668 None] Lock "cinder-18fd8992-7ea2-4948-ad78-2fc3296efe3c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:42 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-297599c6-b126-4f57-939c-7f7b3100ddae tempest-CinderUnicodeTest-2012802668 None] Acquiring lock "cinder-quobyte-308fe409-187a-4180-bfc9-e61a2932ec8d" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:42 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-297599c6-b126-4f57-939c-7f7b3100ddae tempest-CinderUnicodeTest-2012802668 None] Lock "cinder-quobyte-308fe409-187a-4180-bfc9-e61a2932ec8d" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:42 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-297599c6-b126-4f57-939c-7f7b3100ddae tempest-CinderUnicodeTest-2012802668 None] Acquiring lock "cinder-quobyte-18fd8992-7ea2-4948-ad78-2fc3296efe3c" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:42 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-297599c6-b126-4f57-939c-7f7b3100ddae tempest-CinderUnicodeTest-2012802668 None] Lock "cinder-quobyte-18fd8992-7ea2-4948-ad78-2fc3296efe3c" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:42 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-297599c6-b126-4f57-939c-7f7b3100ddae tempest-CinderUnicodeTest-2012802668 None] Deleting offline snapshot 18fd8992-7ea2-4948-ad78-2fc3296efe3c of volume 308fe409-187a-4180-bfc9-e61a2932ec8d {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:01:42 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-297599c6-b126-4f57-939c-7f7b3100ddae tempest-CinderUnicodeTest-2012802668 None] snapshot_file for this snap is: volume-308fe409-187a-4180-bfc9-e61a2932ec8d.18fd8992-7ea2-4948-ad78-2fc3296efe3c {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:01:42 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a990403-94b9-4bb5-af76-53b61d3e9034]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-297599c6-b126-4f57-939c-7f7b3100ddae tempest-CinderUnicodeTest-2012802668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.18fd8992-7ea2-4948-ad78-2fc3296efe3c {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:42 devstack sudo[87797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.18fd8992-7ea2-4948-ad78-2fc3296efe3c Apr 16 23:01:42 devstack sudo[87797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:42 devstack sudo[87793]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5aa886a5-c417-43e8-8f2a-ec397ab10743 tempest-CreateVolumesFromImageTest-1295912401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e25999d2-2318-46bb-9549-e19733462007" returned: 0 in 0.558s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:42 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5aa886a5-c417-43e8-8f2a-ec397ab10743 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "cinder-quobyte-e25999d2-2318-46bb-9549-e19733462007" released by "delete_volume" :: held 1.213s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:42 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-5aa886a5-c417-43e8-8f2a-ec397ab10743 tempest-CreateVolumesFromImageTest-1295912401 None] Created reservations ['c20b598e-19b8-455a-92c7-61dbc8961729', '6403f036-009f-41c0-8ba1-7412163c1604', '68a35160-4556-4120-b5b3-3be6580a1141', '1aa6215a-a591-48fb-8d7f-0945bd2af42a'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:01:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5aa886a5-c417-43e8-8f2a-ec397ab10743 tempest-CreateVolumesFromImageTest-1295912401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5aa886a5-c417-43e8-8f2a-ec397ab10743 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:42 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5aa886a5-c417-43e8-8f2a-ec397ab10743 tempest-CreateVolumesFromImageTest-1295912401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:42 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5aa886a5-c417-43e8-8f2a-ec397ab10743 tempest-CreateVolumesFromImageTest-1295912401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5aa886a5-c417-43e8-8f2a-ec397ab10743 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5aa886a5-c417-43e8-8f2a-ec397ab10743 tempest-CreateVolumesFromImageTest-1295912401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:42 devstack sudo[87800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:01:42 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:43 devstack sudo[87797]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-297599c6-b126-4f57-939c-7f7b3100ddae tempest-CinderUnicodeTest-2012802668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.18fd8992-7ea2-4948-ad78-2fc3296efe3c" returned: 0 in 0.609s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:43 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-297599c6-b126-4f57-939c-7f7b3100ddae tempest-CinderUnicodeTest-2012802668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-308fe409-187a-4180-bfc9-e61a2932ec8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:01:43 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[a932c44c-38e0-46d1-aafc-3c2db20ef7fd]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-297599c6-b126-4f57-939c-7f7b3100ddae tempest-CinderUnicodeTest-2012802668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:43 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-71dbeafd-8c43-4b73-ab4e-26aa88243c91" returned: 0 in 0.947s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:43 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:01:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:43 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3825b0e4-0408-4e42-b038-ddc0fb9dab0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71dbeafd-8c43-4b73-ab4e-26aa88243c91', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:43 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f84e16f2-04d2-400b-ad1f-cdf51732bcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:43 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Volume volume-71dbeafd-8c43-4b73-ab4e-26aa88243c91 (71dbeafd-8c43-4b73-ab4e-26aa88243c91): created successfully Apr 16 23:01:43 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f84e16f2-04d2-400b-ad1f-cdf51732bcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:43 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Flow 'volume_create_manager' (21d4a4a8-5514-48b7-a274-2c79ab4a3ea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:01:43 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-99be25bf-67e0-40f6-950b-80b774cc5780 tempest-VolumeTypesAccessTest-638311942 None] Created volume successfully. Apr 16 23:01:43 devstack sudo[87806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d Apr 16 23:01:43 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:43 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5aa886a5-c417-43e8-8f2a-ec397ab10743 tempest-CreateVolumesFromImageTest-1295912401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.596s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:43 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-5aa886a5-c417-43e8-8f2a-ec397ab10743 tempest-CreateVolumesFromImageTest-1295912401 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:01:43 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-5aa886a5-c417-43e8-8f2a-ec397ab10743 tempest-CreateVolumesFromImageTest-1295912401 None] Deleted volume successfully. Apr 16 23:01:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5aa886a5-c417-43e8-8f2a-ec397ab10743 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "cinder-e25999d2-2318-46bb-9549-e19733462007-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-72d909ba-5eba-4124-8987-966737d1b4d7 tempest-CreateVolumesFromImageTest-1295912401 None] Acquiring lock "cinder-5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-72d909ba-5eba-4124-8987-966737d1b4d7 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "cinder-5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-72d909ba-5eba-4124-8987-966737d1b4d7 tempest-CreateVolumesFromImageTest-1295912401 None] Acquiring lock "cinder-quobyte-5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-72d909ba-5eba-4124-8987-966737d1b4d7 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "cinder-quobyte-5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69" acquired by "delete_volume" :: waited 0.015s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:43 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[14549560-3e50-4965-8512-bdad5ee28c06]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-72d909ba-5eba-4124-8987-966737d1b4d7 tempest-CreateVolumesFromImageTest-1295912401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:43 devstack sudo[87812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69 Apr 16 23:01:43 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:43 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-297599c6-b126-4f57-939c-7f7b3100ddae tempest-CinderUnicodeTest-2012802668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d" returned: 0 in 0.762s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-297599c6-b126-4f57-939c-7f7b3100ddae tempest-CinderUnicodeTest-2012802668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.18fd8992-7ea2-4948-ad78-2fc3296efe3c {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:43 devstack sudo[87814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.18fd8992-7ea2-4948-ad78-2fc3296efe3c Apr 16 23:01:43 devstack sudo[87814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:44 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-08e8109e-5cac-43d8-b56e-2e88cd2006cc tempest-VolumeTypesAccessTest-638311942 None] Acquiring lock "cinder-71dbeafd-8c43-4b73-ab4e-26aa88243c91-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:44 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-08e8109e-5cac-43d8-b56e-2e88cd2006cc tempest-VolumeTypesAccessTest-638311942 None] Lock "cinder-71dbeafd-8c43-4b73-ab4e-26aa88243c91-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:44 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-08e8109e-5cac-43d8-b56e-2e88cd2006cc tempest-VolumeTypesAccessTest-638311942 None] Acquiring lock "cinder-quobyte-71dbeafd-8c43-4b73-ab4e-26aa88243c91" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:44 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-08e8109e-5cac-43d8-b56e-2e88cd2006cc tempest-VolumeTypesAccessTest-638311942 None] Lock "cinder-quobyte-71dbeafd-8c43-4b73-ab4e-26aa88243c91" acquired by "delete_volume" :: waited 0.015s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:44 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-72d909ba-5eba-4124-8987-966737d1b4d7 tempest-CreateVolumesFromImageTest-1295912401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69" returned: 0 in 0.655s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-72d909ba-5eba-4124-8987-966737d1b4d7 tempest-CreateVolumesFromImageTest-1295912401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:44 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[581103de-3148-4498-abd5-071502ab3f64]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-08e8109e-5cac-43d8-b56e-2e88cd2006cc tempest-VolumeTypesAccessTest-638311942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-71dbeafd-8c43-4b73-ab4e-26aa88243c91 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:44 devstack sudo[87819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69 Apr 16 23:01:44 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:44 devstack sudo[87820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-71dbeafd-8c43-4b73-ab4e-26aa88243c91 Apr 16 23:01:44 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:44 devstack sudo[87814]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-297599c6-b126-4f57-939c-7f7b3100ddae tempest-CinderUnicodeTest-2012802668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.18fd8992-7ea2-4948-ad78-2fc3296efe3c" returned: 0 in 0.877s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-297599c6-b126-4f57-939c-7f7b3100ddae tempest-CinderUnicodeTest-2012802668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.18fd8992-7ea2-4948-ad78-2fc3296efe3c {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:44 devstack sudo[87826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.18fd8992-7ea2-4948-ad78-2fc3296efe3c Apr 16 23:01:44 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:45 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-72d909ba-5eba-4124-8987-966737d1b4d7 tempest-CreateVolumesFromImageTest-1295912401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69" returned: 0 in 0.679s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-72d909ba-5eba-4124-8987-966737d1b4d7 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "cinder-quobyte-5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69" released by "delete_volume" :: held 1.364s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-72d909ba-5eba-4124-8987-966737d1b4d7 tempest-CreateVolumesFromImageTest-1295912401 None] Created reservations ['0a87fb18-663e-4c2b-a9f4-00d7e8c8b6df', '27120a22-5e2a-4afe-b0ca-4d631a719595', '24fce8bb-ff2f-4d04-91fc-ba1afbb86c02', 'f6039a80-ee1f-4b3c-a099-7e37e3df953b'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:01:45 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-08e8109e-5cac-43d8-b56e-2e88cd2006cc tempest-VolumeTypesAccessTest-638311942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-71dbeafd-8c43-4b73-ab4e-26aa88243c91" returned: 0 in 0.756s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-08e8109e-5cac-43d8-b56e-2e88cd2006cc tempest-VolumeTypesAccessTest-638311942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-71dbeafd-8c43-4b73-ab4e-26aa88243c91 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-72d909ba-5eba-4124-8987-966737d1b4d7 tempest-CreateVolumesFromImageTest-1295912401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-72d909ba-5eba-4124-8987-966737d1b4d7 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-72d909ba-5eba-4124-8987-966737d1b4d7 tempest-CreateVolumesFromImageTest-1295912401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:45 devstack sudo[87832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-71dbeafd-8c43-4b73-ab4e-26aa88243c91 Apr 16 23:01:45 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-72d909ba-5eba-4124-8987-966737d1b4d7 tempest-CreateVolumesFromImageTest-1295912401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-72d909ba-5eba-4124-8987-966737d1b4d7 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-72d909ba-5eba-4124-8987-966737d1b4d7 tempest-CreateVolumesFromImageTest-1295912401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:45 devstack sudo[87835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:01:45 devstack sudo[87835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:45 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-297599c6-b126-4f57-939c-7f7b3100ddae tempest-CinderUnicodeTest-2012802668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d.18fd8992-7ea2-4948-ad78-2fc3296efe3c" returned: 0 in 0.612s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-297599c6-b126-4f57-939c-7f7b3100ddae tempest-CinderUnicodeTest-2012802668 None] Lock "cinder-quobyte-18fd8992-7ea2-4948-ad78-2fc3296efe3c" released by "_delete_snapshot" :: held 2.953s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-297599c6-b126-4f57-939c-7f7b3100ddae tempest-CinderUnicodeTest-2012802668 None] Lock "cinder-quobyte-308fe409-187a-4180-bfc9-e61a2932ec8d" released by "delete_snapshot" :: held 2.985s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-297599c6-b126-4f57-939c-7f7b3100ddae tempest-CinderUnicodeTest-2012802668 None] Created reservations ['a4e48e27-93e2-49ff-841f-e317af60f95c', '58894e16-22eb-48b6-bb95-f89eb7309822', '196b18a6-52dc-4bf1-8beb-82cacb3a77a2', '81ae6b2e-7d8a-4f03-a897-71a7c6c499cf'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:01:45 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-297599c6-b126-4f57-939c-7f7b3100ddae tempest-CinderUnicodeTest-2012802668 None] Delete snapshot completed successfully. Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-297599c6-b126-4f57-939c-7f7b3100ddae tempest-CinderUnicodeTest-2012802668 None] Lock "cinder-18fd8992-7ea2-4948-ad78-2fc3296efe3c-delete_snapshot" released by "delete_snapshot" :: held 3.130s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-75062f17-2470-43dc-a80a-454dbbb0a1ad tempest-CinderUnicodeTest-2012802668 None] Acquiring lock "cinder-308fe409-187a-4180-bfc9-e61a2932ec8d-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-75062f17-2470-43dc-a80a-454dbbb0a1ad tempest-CinderUnicodeTest-2012802668 None] Lock "cinder-308fe409-187a-4180-bfc9-e61a2932ec8d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-75062f17-2470-43dc-a80a-454dbbb0a1ad tempest-CinderUnicodeTest-2012802668 None] Acquiring lock "cinder-quobyte-308fe409-187a-4180-bfc9-e61a2932ec8d" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-75062f17-2470-43dc-a80a-454dbbb0a1ad tempest-CinderUnicodeTest-2012802668 None] Lock "cinder-quobyte-308fe409-187a-4180-bfc9-e61a2932ec8d" acquired by "delete_volume" :: waited 0.015s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e97c9e-23fb-4e65-abac-240c0c592906]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-75062f17-2470-43dc-a80a-454dbbb0a1ad tempest-CinderUnicodeTest-2012802668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:45 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-08e8109e-5cac-43d8-b56e-2e88cd2006cc tempest-VolumeTypesAccessTest-638311942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-71dbeafd-8c43-4b73-ab4e-26aa88243c91" returned: 0 in 0.620s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-08e8109e-5cac-43d8-b56e-2e88cd2006cc tempest-VolumeTypesAccessTest-638311942 None] Lock "cinder-quobyte-71dbeafd-8c43-4b73-ab4e-26aa88243c91" released by "delete_volume" :: held 1.417s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:45 devstack cinder-volume[81971]: WARNING cinder.quota [None req-08e8109e-5cac-43d8-b56e-2e88cd2006cc tempest-VolumeTypesAccessTest-638311942 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1070563248 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1070563248, it is now deprecated. Please use the default quota class for default quota. Apr 16 23:01:45 devstack cinder-volume[81971]: WARNING cinder.quota [None req-08e8109e-5cac-43d8-b56e-2e88cd2006cc tempest-VolumeTypesAccessTest-638311942 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1070563248 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1070563248, it is now deprecated. Please use the default quota class for default quota. Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-08e8109e-5cac-43d8-b56e-2e88cd2006cc tempest-VolumeTypesAccessTest-638311942 None] Created reservations ['4e64cb60-7541-426f-bf2d-2ea55141acec', '0357aaaf-0451-4ac6-90e0-6f4add575082', 'ff15934a-a904-4a53-aa73-f3dcd8bef50d', 'c46db2f8-d042-44a6-b132-75a5b8b012b6'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:01:45 devstack sudo[87839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d Apr 16 23:01:45 devstack sudo[87839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-08e8109e-5cac-43d8-b56e-2e88cd2006cc tempest-VolumeTypesAccessTest-638311942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-08e8109e-5cac-43d8-b56e-2e88cd2006cc tempest-VolumeTypesAccessTest-638311942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-08e8109e-5cac-43d8-b56e-2e88cd2006cc tempest-VolumeTypesAccessTest-638311942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-08e8109e-5cac-43d8-b56e-2e88cd2006cc tempest-VolumeTypesAccessTest-638311942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-08e8109e-5cac-43d8-b56e-2e88cd2006cc tempest-VolumeTypesAccessTest-638311942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-08e8109e-5cac-43d8-b56e-2e88cd2006cc tempest-VolumeTypesAccessTest-638311942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:45 devstack sudo[87835]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-72d909ba-5eba-4124-8987-966737d1b4d7 tempest-CreateVolumesFromImageTest-1295912401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.691s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-72d909ba-5eba-4124-8987-966737d1b4d7 tempest-CreateVolumesFromImageTest-1295912401 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:01:45 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-72d909ba-5eba-4124-8987-966737d1b4d7 tempest-CreateVolumesFromImageTest-1295912401 None] Deleted volume successfully. Apr 16 23:01:45 devstack sudo[87842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:01:45 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-72d909ba-5eba-4124-8987-966737d1b4d7 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "cinder-5bd0f99b-540f-45f1-9aaf-5bc53f7bbc69-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bcd96959-2bac-4321-8b75-282bfd5dddaf tempest-CreateVolumesFromImageTest-1295912401 None] Acquiring lock "cinder-7301d839-14e9-4fa6-a296-a5e0b1214f0e-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bcd96959-2bac-4321-8b75-282bfd5dddaf tempest-CreateVolumesFromImageTest-1295912401 None] Lock "cinder-7301d839-14e9-4fa6-a296-a5e0b1214f0e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bcd96959-2bac-4321-8b75-282bfd5dddaf tempest-CreateVolumesFromImageTest-1295912401 None] Acquiring lock "cinder-quobyte-7301d839-14e9-4fa6-a296-a5e0b1214f0e" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bcd96959-2bac-4321-8b75-282bfd5dddaf tempest-CreateVolumesFromImageTest-1295912401 None] Lock "cinder-quobyte-7301d839-14e9-4fa6-a296-a5e0b1214f0e" acquired by "delete_volume" :: waited 0.007s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:46 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[7688f8ad-8db2-45dc-a4c9-8cc5a1ac23f9]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bcd96959-2bac-4321-8b75-282bfd5dddaf tempest-CreateVolumesFromImageTest-1295912401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7301d839-14e9-4fa6-a296-a5e0b1214f0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:46 devstack sudo[87844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7301d839-14e9-4fa6-a296-a5e0b1214f0e Apr 16 23:01:46 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:46 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-08e8109e-5cac-43d8-b56e-2e88cd2006cc tempest-VolumeTypesAccessTest-638311942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.510s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:46 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-08e8109e-5cac-43d8-b56e-2e88cd2006cc tempest-VolumeTypesAccessTest-638311942 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:01:46 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-08e8109e-5cac-43d8-b56e-2e88cd2006cc tempest-VolumeTypesAccessTest-638311942 None] Deleted volume successfully. Apr 16 23:01:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-08e8109e-5cac-43d8-b56e-2e88cd2006cc tempest-VolumeTypesAccessTest-638311942 None] Lock "cinder-71dbeafd-8c43-4b73-ab4e-26aa88243c91-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:46 devstack sudo[87839]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-75062f17-2470-43dc-a80a-454dbbb0a1ad tempest-CinderUnicodeTest-2012802668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d" returned: 0 in 0.878s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-75062f17-2470-43dc-a80a-454dbbb0a1ad tempest-CinderUnicodeTest-2012802668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:46 devstack sudo[87857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d Apr 16 23:01:46 devstack sudo[87857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:46 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bcd96959-2bac-4321-8b75-282bfd5dddaf tempest-CreateVolumesFromImageTest-1295912401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7301d839-14e9-4fa6-a296-a5e0b1214f0e" returned: 0 in 0.675s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bcd96959-2bac-4321-8b75-282bfd5dddaf tempest-CreateVolumesFromImageTest-1295912401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7301d839-14e9-4fa6-a296-a5e0b1214f0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:46 devstack sudo[87861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7301d839-14e9-4fa6-a296-a5e0b1214f0e Apr 16 23:01:46 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:47 devstack sudo[87857]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-75062f17-2470-43dc-a80a-454dbbb0a1ad tempest-CinderUnicodeTest-2012802668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-308fe409-187a-4180-bfc9-e61a2932ec8d" returned: 0 in 0.552s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:47 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-75062f17-2470-43dc-a80a-454dbbb0a1ad tempest-CinderUnicodeTest-2012802668 None] Lock "cinder-quobyte-308fe409-187a-4180-bfc9-e61a2932ec8d" released by "delete_volume" :: held 1.472s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:47 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-75062f17-2470-43dc-a80a-454dbbb0a1ad tempest-CinderUnicodeTest-2012802668 None] Created reservations ['a40cfeb3-6f64-4195-bc25-8e4e08f127e3', '10e2ac8b-db53-4263-93f1-f83da4449a90', '76ebceb5-044a-4494-bc46-ef5664a7d157', '20646469-37fd-4fef-bdd8-51fe438c75d4'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:01:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-75062f17-2470-43dc-a80a-454dbbb0a1ad tempest-CinderUnicodeTest-2012802668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-75062f17-2470-43dc-a80a-454dbbb0a1ad tempest-CinderUnicodeTest-2012802668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:47 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-75062f17-2470-43dc-a80a-454dbbb0a1ad tempest-CinderUnicodeTest-2012802668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:47 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-75062f17-2470-43dc-a80a-454dbbb0a1ad tempest-CinderUnicodeTest-2012802668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-75062f17-2470-43dc-a80a-454dbbb0a1ad tempest-CinderUnicodeTest-2012802668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-75062f17-2470-43dc-a80a-454dbbb0a1ad tempest-CinderUnicodeTest-2012802668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:47 devstack sudo[87865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:01:47 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:47 devstack sudo[87865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bcd96959-2bac-4321-8b75-282bfd5dddaf tempest-CreateVolumesFromImageTest-1295912401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-7301d839-14e9-4fa6-a296-a5e0b1214f0e" returned: 0 in 0.581s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:47 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bcd96959-2bac-4321-8b75-282bfd5dddaf tempest-CreateVolumesFromImageTest-1295912401 None] Lock "cinder-quobyte-7301d839-14e9-4fa6-a296-a5e0b1214f0e" released by "delete_volume" :: held 1.290s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:47 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-bcd96959-2bac-4321-8b75-282bfd5dddaf tempest-CreateVolumesFromImageTest-1295912401 None] Created reservations ['db17117b-471b-4957-bfa5-2d11286221bf', 'b4058fde-3d5d-4432-b9d1-e04b99ecc10c', '2466f3a9-6664-4b71-b267-5f8e7eebc60d', '303df7f7-3f04-448c-a832-67cdf4d005fd'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:01:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bcd96959-2bac-4321-8b75-282bfd5dddaf tempest-CreateVolumesFromImageTest-1295912401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bcd96959-2bac-4321-8b75-282bfd5dddaf tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:47 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-bcd96959-2bac-4321-8b75-282bfd5dddaf tempest-CreateVolumesFromImageTest-1295912401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:47 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-bcd96959-2bac-4321-8b75-282bfd5dddaf tempest-CreateVolumesFromImageTest-1295912401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bcd96959-2bac-4321-8b75-282bfd5dddaf tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bcd96959-2bac-4321-8b75-282bfd5dddaf tempest-CreateVolumesFromImageTest-1295912401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:47 devstack sudo[87867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:01:47 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:47 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-daa81213-59a7-45c4-a640-96eb0026b7bb tempest-CinderUnicodeTest-2012802668 None] Acquiring lock "cinder-3bf9ae21-e04b-49fd-8780-5a061b9e3261-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:47 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-daa81213-59a7-45c4-a640-96eb0026b7bb tempest-CinderUnicodeTest-2012802668 None] Lock "cinder-3bf9ae21-e04b-49fd-8780-5a061b9e3261-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:47 devstack sudo[87865]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-75062f17-2470-43dc-a80a-454dbbb0a1ad tempest-CinderUnicodeTest-2012802668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.678s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:47 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-75062f17-2470-43dc-a80a-454dbbb0a1ad tempest-CinderUnicodeTest-2012802668 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:01:47 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-daa81213-59a7-45c4-a640-96eb0026b7bb tempest-CinderUnicodeTest-2012802668 None] Acquiring lock "cinder-quobyte-3bf9ae21-e04b-49fd-8780-5a061b9e3261" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:47 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-75062f17-2470-43dc-a80a-454dbbb0a1ad tempest-CinderUnicodeTest-2012802668 None] Deleted volume successfully. Apr 16 23:01:47 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-daa81213-59a7-45c4-a640-96eb0026b7bb tempest-CinderUnicodeTest-2012802668 None] Lock "cinder-quobyte-3bf9ae21-e04b-49fd-8780-5a061b9e3261" acquired by "delete_volume" :: waited 0.028s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:48 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-75062f17-2470-43dc-a80a-454dbbb0a1ad tempest-CinderUnicodeTest-2012802668 None] Lock "cinder-308fe409-187a-4180-bfc9-e61a2932ec8d-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:48 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cecfd46-a9dd-498f-aab5-d18a298caf02]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-daa81213-59a7-45c4-a640-96eb0026b7bb tempest-CinderUnicodeTest-2012802668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3bf9ae21-e04b-49fd-8780-5a061b9e3261 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:48 devstack sudo[87870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3bf9ae21-e04b-49fd-8780-5a061b9e3261 Apr 16 23:01:48 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:48 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:48 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4f145679-6319-41f5-aa73-ae607e896813 tempest-CreateVolumesFromImageTest-1295912401 None] Acquiring lock "cinder-e3487c8d-de1d-4618-97bc-bd2566db7415-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bcd96959-2bac-4321-8b75-282bfd5dddaf tempest-CreateVolumesFromImageTest-1295912401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.789s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:48 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-bcd96959-2bac-4321-8b75-282bfd5dddaf tempest-CreateVolumesFromImageTest-1295912401 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:01:48 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-bcd96959-2bac-4321-8b75-282bfd5dddaf tempest-CreateVolumesFromImageTest-1295912401 None] Deleted volume successfully. Apr 16 23:01:48 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4f145679-6319-41f5-aa73-ae607e896813 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "cinder-e3487c8d-de1d-4618-97bc-bd2566db7415-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:48 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bcd96959-2bac-4321-8b75-282bfd5dddaf tempest-CreateVolumesFromImageTest-1295912401 None] Lock "cinder-7301d839-14e9-4fa6-a296-a5e0b1214f0e-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:48 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4f145679-6319-41f5-aa73-ae607e896813 tempest-CreateVolumesFromImageTest-1295912401 None] Acquiring lock "cinder-quobyte-e3487c8d-de1d-4618-97bc-bd2566db7415" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:48 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4f145679-6319-41f5-aa73-ae607e896813 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "cinder-quobyte-e3487c8d-de1d-4618-97bc-bd2566db7415" acquired by "delete_volume" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:48 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59efa50-4b4c-45bc-8abd-84040a569688]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4f145679-6319-41f5-aa73-ae607e896813 tempest-CreateVolumesFromImageTest-1295912401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e3487c8d-de1d-4618-97bc-bd2566db7415 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:48 devstack sudo[87873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e3487c8d-de1d-4618-97bc-bd2566db7415 Apr 16 23:01:48 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:49 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-daa81213-59a7-45c4-a640-96eb0026b7bb tempest-CinderUnicodeTest-2012802668 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3bf9ae21-e04b-49fd-8780-5a061b9e3261" returned: 0 in 0.989s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-daa81213-59a7-45c4-a640-96eb0026b7bb tempest-CinderUnicodeTest-2012802668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3bf9ae21-e04b-49fd-8780-5a061b9e3261 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:49 devstack sudo[87879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3bf9ae21-e04b-49fd-8780-5a061b9e3261 Apr 16 23:01:49 devstack sudo[87879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:49 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4f145679-6319-41f5-aa73-ae607e896813 tempest-CreateVolumesFromImageTest-1295912401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e3487c8d-de1d-4618-97bc-bd2566db7415" returned: 0 in 0.917s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4f145679-6319-41f5-aa73-ae607e896813 tempest-CreateVolumesFromImageTest-1295912401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e3487c8d-de1d-4618-97bc-bd2566db7415 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:49 devstack sudo[87884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e3487c8d-de1d-4618-97bc-bd2566db7415 Apr 16 23:01:49 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:49 devstack sudo[87879]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-daa81213-59a7-45c4-a640-96eb0026b7bb tempest-CinderUnicodeTest-2012802668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3bf9ae21-e04b-49fd-8780-5a061b9e3261" returned: 0 in 0.586s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:49 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-daa81213-59a7-45c4-a640-96eb0026b7bb tempest-CinderUnicodeTest-2012802668 None] Lock "cinder-quobyte-3bf9ae21-e04b-49fd-8780-5a061b9e3261" released by "delete_volume" :: held 1.616s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:49 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-daa81213-59a7-45c4-a640-96eb0026b7bb tempest-CinderUnicodeTest-2012802668 None] Created reservations ['d0e62b9d-3b39-4355-96d4-2d5b86165712', '516d26c1-386f-4ae3-96ee-3a8a997caca7', 'fab84243-5bf4-4270-8337-776655017a45', '429d8392-525a-4099-bc14-1d273ec3c547'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:01:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-daa81213-59a7-45c4-a640-96eb0026b7bb tempest-CinderUnicodeTest-2012802668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-daa81213-59a7-45c4-a640-96eb0026b7bb tempest-CinderUnicodeTest-2012802668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-daa81213-59a7-45c4-a640-96eb0026b7bb tempest-CinderUnicodeTest-2012802668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-daa81213-59a7-45c4-a640-96eb0026b7bb tempest-CinderUnicodeTest-2012802668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-daa81213-59a7-45c4-a640-96eb0026b7bb tempest-CinderUnicodeTest-2012802668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-daa81213-59a7-45c4-a640-96eb0026b7bb tempest-CinderUnicodeTest-2012802668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:49 devstack sudo[87887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:01:49 devstack sudo[87887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:50 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4f145679-6319-41f5-aa73-ae607e896813 tempest-CreateVolumesFromImageTest-1295912401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e3487c8d-de1d-4618-97bc-bd2566db7415" returned: 0 in 0.715s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:50 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4f145679-6319-41f5-aa73-ae607e896813 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "cinder-quobyte-e3487c8d-de1d-4618-97bc-bd2566db7415" released by "delete_volume" :: held 1.670s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:50 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-4f145679-6319-41f5-aa73-ae607e896813 tempest-CreateVolumesFromImageTest-1295912401 None] Created reservations ['05a12ef4-c8da-4148-bad4-6aa194e9214a', '72d7592e-a63d-4542-b7d0-629a48ac949a', '83655b1e-7a40-428c-b835-696910479909', 'fad6f023-2279-4c96-be0a-c761f7196f4e'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:01:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-4f145679-6319-41f5-aa73-ae607e896813 tempest-CreateVolumesFromImageTest-1295912401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-4f145679-6319-41f5-aa73-ae607e896813 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:50 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-4f145679-6319-41f5-aa73-ae607e896813 tempest-CreateVolumesFromImageTest-1295912401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:50 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-4f145679-6319-41f5-aa73-ae607e896813 tempest-CreateVolumesFromImageTest-1295912401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-4f145679-6319-41f5-aa73-ae607e896813 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4f145679-6319-41f5-aa73-ae607e896813 tempest-CreateVolumesFromImageTest-1295912401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:50 devstack sudo[87892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:01:50 devstack sudo[87892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:50 devstack sudo[87887]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-daa81213-59a7-45c4-a640-96eb0026b7bb tempest-CinderUnicodeTest-2012802668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.988s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:50 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-daa81213-59a7-45c4-a640-96eb0026b7bb tempest-CinderUnicodeTest-2012802668 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:01:50 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-daa81213-59a7-45c4-a640-96eb0026b7bb tempest-CinderUnicodeTest-2012802668 None] Deleted volume successfully. Apr 16 23:01:50 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-daa81213-59a7-45c4-a640-96eb0026b7bb tempest-CinderUnicodeTest-2012802668 None] Lock "cinder-3bf9ae21-e04b-49fd-8780-5a061b9e3261-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:50 devstack sudo[87892]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4f145679-6319-41f5-aa73-ae607e896813 tempest-CreateVolumesFromImageTest-1295912401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.789s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:50 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-4f145679-6319-41f5-aa73-ae607e896813 tempest-CreateVolumesFromImageTest-1295912401 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:01:51 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-4f145679-6319-41f5-aa73-ae607e896813 tempest-CreateVolumesFromImageTest-1295912401 None] Deleted volume successfully. Apr 16 23:01:51 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4f145679-6319-41f5-aa73-ae607e896813 tempest-CreateVolumesFromImageTest-1295912401 None] Lock "cinder-e3487c8d-de1d-4618-97bc-bd2566db7415-delete_volume" released by "delete_volume" :: held 2.678s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:01:53 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:01:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Flow 'volume_create_manager' (1ff964fc-51a3-4d7f-87ae-715bf4ddb722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:01:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7dabe9d-a543-426f-bdfd-60cfdce25fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7dabe9d-a543-426f-bdfd-60cfdce25fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1918337912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e8fe6865c5407bab0b3bf34304ec74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:01:53Z,use_quota=True,user_id='2843913626f2404799e5dfe3812dd95b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6b8ed4-c88b-4ced-9abb-a0e1a6758150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6b8ed4-c88b-4ced-9abb-a0e1a6758150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928a6509-c003-4bce-99f5-cca1b4055802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928a6509-c003-4bce-99f5-cca1b4055802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4', 'volume_name': 'volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2132cf10-76d9-4287-bbf7-a2b40a84db5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2132cf10-76d9-4287-bbf7-a2b40a84db5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9c3a70-73d5-4cee-92fc-bd2148a50cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:53 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Volume b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4', 'volume_size': 1} Apr 16 23:01:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:53 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1918337912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20e8fe6865c5407bab0b3bf34304ec74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:01:53Z,use_quota=True,user_id='2843913626f2404799e5dfe3812dd95b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:01:53 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Creating volume b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:01:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:53 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:53 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:53 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:01:53 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:01:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:53 devstack sudo[87899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4 1073741824 Apr 16 23:01:53 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:54 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4 1073741824" returned: 0 in 0.656s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:54 devstack sudo[87904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4 Apr 16 23:01:54 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:54 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4" returned: 0 in 0.474s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:54 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:01:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:54 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9c3a70-73d5-4cee-92fc-bd2148a50cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:54 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8a3670-2a2b-416f-82a0-9c7e4871c472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:54 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Volume volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4 (b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4): created successfully Apr 16 23:01:54 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f8a3670-2a2b-416f-82a0-9c7e4871c472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:54 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Flow 'volume_create_manager' (1ff964fc-51a3-4d7f-87ae-715bf4ddb722) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:01:54 devstack cinder-volume[81971]: INFO cinder.volume.manager [req-dc150f83-2d4a-4b53-be65-19a5e2a4ae98 req-7cf40d30-6686-4aa4-8f68-d427e13a5dc9 tempest-VolumesSnapshotsTestJSON-935107166 None] Created volume successfully. Apr 16 23:01:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-66a31639-e2c9-4f1e-a04f-1a681b45c691 req-15bd24ff-12b6-4113-88ee-a7b735eabded tempest-VolumesSnapshotsTestJSON-935107166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-66a31639-e2c9-4f1e-a04f-1a681b45c691 req-15bd24ff-12b6-4113-88ee-a7b735eabded tempest-VolumesSnapshotsTestJSON-935107166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:55 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [req-66a31639-e2c9-4f1e-a04f-1a681b45c691 req-15bd24ff-12b6-4113-88ee-a7b735eabded tempest-VolumesSnapshotsTestJSON-935107166 None] Creating offline snapshot 3620fe2d-3de5-493d-8df0-a7983305422d of volume b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4 {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:01:55 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f9dc05-a0ea-41fc-82c1-fa19ee060a24]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-66a31639-e2c9-4f1e-a04f-1a681b45c691 req-15bd24ff-12b6-4113-88ee-a7b735eabded tempest-VolumesSnapshotsTestJSON-935107166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:55 devstack sudo[87907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4 Apr 16 23:01:55 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:56 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-66a31639-e2c9-4f1e-a04f-1a681b45c691 req-15bd24ff-12b6-4113-88ee-a7b735eabded tempest-VolumesSnapshotsTestJSON-935107166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4" returned: 0 in 0.655s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-66a31639-e2c9-4f1e-a04f-1a681b45c691 req-15bd24ff-12b6-4113-88ee-a7b735eabded tempest-VolumesSnapshotsTestJSON-935107166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.3620fe2d-3de5-493d-8df0-a7983305422d 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:56 devstack sudo[87912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.3620fe2d-3de5-493d-8df0-a7983305422d 1G Apr 16 23:01:56 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:56 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-66a31639-e2c9-4f1e-a04f-1a681b45c691 req-15bd24ff-12b6-4113-88ee-a7b735eabded tempest-VolumesSnapshotsTestJSON-935107166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.3620fe2d-3de5-493d-8df0-a7983305422d 1G" returned: 0 in 0.554s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-66a31639-e2c9-4f1e-a04f-1a681b45c691 req-15bd24ff-12b6-4113-88ee-a7b735eabded tempest-VolumesSnapshotsTestJSON-935107166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.3620fe2d-3de5-493d-8df0-a7983305422d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:56 devstack sudo[87917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.3620fe2d-3de5-493d-8df0-a7983305422d Apr 16 23:01:56 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:57 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-66a31639-e2c9-4f1e-a04f-1a681b45c691 req-15bd24ff-12b6-4113-88ee-a7b735eabded tempest-VolumesSnapshotsTestJSON-935107166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.3620fe2d-3de5-493d-8df0-a7983305422d" returned: 0 in 0.486s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:57 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [req-66a31639-e2c9-4f1e-a04f-1a681b45c691 req-15bd24ff-12b6-4113-88ee-a7b735eabded tempest-VolumesSnapshotsTestJSON-935107166 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.3620fe2d-3de5-493d-8df0-a7983305422d is being set with open permissions: ugo+rw Apr 16 23:01:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-66a31639-e2c9-4f1e-a04f-1a681b45c691 req-15bd24ff-12b6-4113-88ee-a7b735eabded tempest-VolumesSnapshotsTestJSON-935107166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.3620fe2d-3de5-493d-8df0-a7983305422d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:57 devstack sudo[87922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.3620fe2d-3de5-493d-8df0-a7983305422d Apr 16 23:01:57 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:57 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-66a31639-e2c9-4f1e-a04f-1a681b45c691 req-15bd24ff-12b6-4113-88ee-a7b735eabded tempest-VolumesSnapshotsTestJSON-935107166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.3620fe2d-3de5-493d-8df0-a7983305422d" returned: 0 in 0.494s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-66a31639-e2c9-4f1e-a04f-1a681b45c691 req-15bd24ff-12b6-4113-88ee-a7b735eabded tempest-VolumesSnapshotsTestJSON-935107166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:57 devstack sudo[87925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.info Apr 16 23:01:57 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:58 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:01:58 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Flow 'volume_create_manager' (b1e38207-bb87-497c-a442-e46b62b4f13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:01:58 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf586f68-dbd6-4d57-8046-f9908f9ee2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:58 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf586f68-dbd6-4d57-8046-f9908f9ee2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1614287710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=543b7f76-a750-4835-b911-41ab151175de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50895bd45d7472bad83001c2f398b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:01:58Z,use_quota=True,user_id='32aad6df55bd40fea95db566ae4e216c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:58 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82bec75d-0ee9-43f8-ac9b-8b98fa8219c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:58 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82bec75d-0ee9-43f8-ac9b-8b98fa8219c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:58 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c2e3a84-6411-4b59-a3e1-53986c8ba52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:58 devstack cinder-volume[81971]: DEBUG cinder.image.glance [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Creating Keystone auth plugin from conf {{(pid=81971) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 23:01:58 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c2e3a84-6411-4b59-a3e1-53986c8ba52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '543b7f76-a750-4835-b911-41ab151175de', 'volume_name': 'volume-543b7f76-a750-4835-b911-41ab151175de', 'volume_size': 1, 'image_id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '70c7e2479fd847c6b5fabb2201f59bd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'created_at': datetime.datetime(2026, 4, 16, 20, 51, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 20, 51, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:58 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34bc0e4-fbac-4fee-ad4b-d115c45c3fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:58 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34bc0e4-fbac-4fee-ad4b-d115c45c3fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:01:58 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff2db97-27f9-4d33-bd1e-bc8d4143278d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:01:58 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Volume 543b7f76-a750-4835-b911-41ab151175de: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-543b7f76-a750-4835-b911-41ab151175de', 'volume_size': 1, 'image_id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '70c7e2479fd847c6b5fabb2201f59bd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'created_at': datetime.datetime(2026, 4, 16, 20, 51, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 20, 51, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 23:01:58 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Trying to clone 543b7f76-a750-4835-b911-41ab151175de from image f3c20cd6-f75b-4471-a89e-2a8c84f8b824 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'metadata': {}}]). {{(pid=81971) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 23:01:58 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-66a31639-e2c9-4f1e-a04f-1a681b45c691 req-15bd24ff-12b6-4113-88ee-a7b735eabded tempest-VolumesSnapshotsTestJSON-935107166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.info" returned: 0 in 0.509s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:58 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [req-66a31639-e2c9-4f1e-a04f-1a681b45c691 req-15bd24ff-12b6-4113-88ee-a7b735eabded tempest-VolumesSnapshotsTestJSON-935107166 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.info is being set with open permissions: ugo+rw Apr 16 23:01:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-66a31639-e2c9-4f1e-a04f-1a681b45c691 req-15bd24ff-12b6-4113-88ee-a7b735eabded tempest-VolumesSnapshotsTestJSON-935107166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:58 devstack sudo[87928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.info Apr 16 23:01:58 devstack sudo[87928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:58 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824__0drjfr7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81971) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 23:01:58 devstack cinder-volume[81971]: INFO cinder.image.image_utils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Image download 20.69 MB at 20.69 MB/s Apr 16 23:01:58 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfbf5ce-c77c-4da9-9c1f-fe790c35a5b9]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824__0drjfr7devstack@QuobyteHD {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:58 devstack sudo[87931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824__0drjfr7devstack@QuobyteHD Apr 16 23:01:58 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:58 devstack sudo[87928]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-66a31639-e2c9-4f1e-a04f-1a681b45c691 req-15bd24ff-12b6-4113-88ee-a7b735eabded tempest-VolumesSnapshotsTestJSON-935107166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.info" returned: 0 in 0.516s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-66a31639-e2c9-4f1e-a04f-1a681b45c691 req-15bd24ff-12b6-4113-88ee-a7b735eabded tempest-VolumesSnapshotsTestJSON-935107166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.284s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:58 devstack cinder-volume[81971]: INFO cinder.volume.manager [req-66a31639-e2c9-4f1e-a04f-1a681b45c691 req-15bd24ff-12b6-4113-88ee-a7b735eabded tempest-VolumesSnapshotsTestJSON-935107166 None] Create snapshot completed successfully Apr 16 23:01:59 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824__0drjfr7devstack@QuobyteHD" returned: 0 in 0.604s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Temporary image f3c20cd6-f75b-4471-a89e-2a8c84f8b824 is fetched for user 32aad6df55bd40fea95db566ae4e216c. {{(pid=81971) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-6a935eb0-2534-48ac-9c46-26b6c3dee596 req-79515195-b444-4187-b23e-9e5690399428 tempest-VolumesSnapshotsTestJSON-935107166 None] Acquiring lock "cinder-3620fe2d-3de5-493d-8df0-a7983305422d-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-6a935eb0-2534-48ac-9c46-26b6c3dee596 req-79515195-b444-4187-b23e-9e5690399428 tempest-VolumesSnapshotsTestJSON-935107166 None] Lock "cinder-3620fe2d-3de5-493d-8df0-a7983305422d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-6a935eb0-2534-48ac-9c46-26b6c3dee596 req-79515195-b444-4187-b23e-9e5690399428 tempest-VolumesSnapshotsTestJSON-935107166 None] Acquiring lock "cinder-quobyte-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e42d8f-adcb-4adc-981d-7d72aa3419e2]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824__0drjfr7devstack@QuobyteHD {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-6a935eb0-2534-48ac-9c46-26b6c3dee596 req-79515195-b444-4187-b23e-9e5690399428 tempest-VolumesSnapshotsTestJSON-935107166 None] Lock "cinder-quobyte-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4" acquired by "delete_snapshot" :: waited 0.028s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-6a935eb0-2534-48ac-9c46-26b6c3dee596 req-79515195-b444-4187-b23e-9e5690399428 tempest-VolumesSnapshotsTestJSON-935107166 None] Acquiring lock "cinder-quobyte-3620fe2d-3de5-493d-8df0-a7983305422d" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-6a935eb0-2534-48ac-9c46-26b6c3dee596 req-79515195-b444-4187-b23e-9e5690399428 tempest-VolumesSnapshotsTestJSON-935107166 None] Lock "cinder-quobyte-3620fe2d-3de5-493d-8df0-a7983305422d" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [req-6a935eb0-2534-48ac-9c46-26b6c3dee596 req-79515195-b444-4187-b23e-9e5690399428 tempest-VolumesSnapshotsTestJSON-935107166 None] Deleting offline snapshot 3620fe2d-3de5-493d-8df0-a7983305422d of volume b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [req-6a935eb0-2534-48ac-9c46-26b6c3dee596 req-79515195-b444-4187-b23e-9e5690399428 tempest-VolumesSnapshotsTestJSON-935107166 None] snapshot_file for this snap is: volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.3620fe2d-3de5-493d-8df0-a7983305422d {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f796478-7fa3-4e05-81b5-0633c3486985]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-6a935eb0-2534-48ac-9c46-26b6c3dee596 req-79515195-b444-4187-b23e-9e5690399428 tempest-VolumesSnapshotsTestJSON-935107166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.3620fe2d-3de5-493d-8df0-a7983305422d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:59 devstack sudo[87971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824__0drjfr7devstack@QuobyteHD Apr 16 23:01:59 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:59 devstack sudo[87972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.3620fe2d-3de5-493d-8df0-a7983305422d Apr 16 23:01:59 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:59 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824__0drjfr7devstack@QuobyteHD" returned: 0 in 0.503s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1614287710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=543b7f76-a750-4835-b911-41ab151175de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50895bd45d7472bad83001c2f398b44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:01:58Z,use_quota=True,user_id='32aad6df55bd40fea95db566ae4e216c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Creating volume 543b7f76-a750-4835-b911-41ab151175de {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:01:59 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:59 devstack sudo[87981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de 1073741824 Apr 16 23:01:59 devstack sudo[87981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:01:59 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-6a935eb0-2534-48ac-9c46-26b6c3dee596 req-79515195-b444-4187-b23e-9e5690399428 tempest-VolumesSnapshotsTestJSON-935107166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.3620fe2d-3de5-493d-8df0-a7983305422d" returned: 0 in 0.511s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [req-6a935eb0-2534-48ac-9c46-26b6c3dee596 req-79515195-b444-4187-b23e-9e5690399428 tempest-VolumesSnapshotsTestJSON-935107166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf24dd7-7490-49c4-93fe-437b68a62e99]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:01:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-6a935eb0-2534-48ac-9c46-26b6c3dee596 req-79515195-b444-4187-b23e-9e5690399428 tempest-VolumesSnapshotsTestJSON-935107166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:01:59 devstack sudo[87983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4 Apr 16 23:01:59 devstack sudo[87983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:00 devstack sudo[87981]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de 1073741824" returned: 0 in 0.624s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:00 devstack sudo[87983]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-6a935eb0-2534-48ac-9c46-26b6c3dee596 req-79515195-b444-4187-b23e-9e5690399428 tempest-VolumesSnapshotsTestJSON-935107166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4" returned: 0 in 0.600s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-6a935eb0-2534-48ac-9c46-26b6c3dee596 req-79515195-b444-4187-b23e-9e5690399428 tempest-VolumesSnapshotsTestJSON-935107166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.3620fe2d-3de5-493d-8df0-a7983305422d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:00 devstack sudo[87991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de Apr 16 23:02:00 devstack sudo[87991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:00 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.3620fe2d-3de5-493d-8df0-a7983305422d Apr 16 23:02:00 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:00 devstack sudo[87991]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de" returned: 0 in 0.526s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:00 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:02:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:00 devstack cinder-volume[81971]: DEBUG cinder.volume.volume_utils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Attempting download of f3c20cd6-f75b-4471-a89e-2a8c84f8b824 ((None, [{'url': 'file:///opt/stack/data/glance/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'metadata': {}}])) to volume 543b7f76-a750-4835-b911-41ab151175de. {{(pid=81971) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 16 23:02:00 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55d9f59-c765-4f98-a2d5-ab0147aba457]: (4, 'raw') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_wb7z70o1 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:01 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-6a935eb0-2534-48ac-9c46-26b6c3dee596 req-79515195-b444-4187-b23e-9e5690399428 tempest-VolumesSnapshotsTestJSON-935107166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.3620fe2d-3de5-493d-8df0-a7983305422d" returned: 0 in 0.631s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-6a935eb0-2534-48ac-9c46-26b6c3dee596 req-79515195-b444-4187-b23e-9e5690399428 tempest-VolumesSnapshotsTestJSON-935107166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.3620fe2d-3de5-493d-8df0-a7983305422d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:01 devstack sudo[88000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.3620fe2d-3de5-493d-8df0-a7983305422d Apr 16 23:02:01 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:01 devstack sudo[87999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_wb7z70o1 Apr 16 23:02:01 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:01 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-6a935eb0-2534-48ac-9c46-26b6c3dee596 req-79515195-b444-4187-b23e-9e5690399428 tempest-VolumesSnapshotsTestJSON-935107166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4.3620fe2d-3de5-493d-8df0-a7983305422d" returned: 0 in 0.507s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:01 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_wb7z70o1" returned: 0 in 0.570s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_wb7z70o1 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:01 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-6a935eb0-2534-48ac-9c46-26b6c3dee596 req-79515195-b444-4187-b23e-9e5690399428 tempest-VolumesSnapshotsTestJSON-935107166 None] Lock "cinder-quobyte-3620fe2d-3de5-493d-8df0-a7983305422d" released by "_delete_snapshot" :: held 2.355s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:01 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-6a935eb0-2534-48ac-9c46-26b6c3dee596 req-79515195-b444-4187-b23e-9e5690399428 tempest-VolumesSnapshotsTestJSON-935107166 None] Lock "cinder-quobyte-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4" released by "delete_snapshot" :: held 2.373s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:01 devstack sudo[88006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_wb7z70o1 Apr 16 23:02:01 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:01 devstack cinder-volume[81971]: DEBUG cinder.quota [req-6a935eb0-2534-48ac-9c46-26b6c3dee596 req-79515195-b444-4187-b23e-9e5690399428 tempest-VolumesSnapshotsTestJSON-935107166 None] Created reservations ['7faf8f9e-9216-40a1-8eaf-4b9abbabf449', '820b0247-2e7a-40e2-93a6-4a831f0dd374', '1ad46e67-0c74-41d2-a488-ad00273aed6a', 'bae92170-bff0-4790-960f-bda0f66c24df'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:02:01 devstack cinder-volume[81971]: INFO cinder.volume.manager [req-6a935eb0-2534-48ac-9c46-26b6c3dee596 req-79515195-b444-4187-b23e-9e5690399428 tempest-VolumesSnapshotsTestJSON-935107166 None] Delete snapshot completed successfully. Apr 16 23:02:01 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-6a935eb0-2534-48ac-9c46-26b6c3dee596 req-79515195-b444-4187-b23e-9e5690399428 tempest-VolumesSnapshotsTestJSON-935107166 None] Lock "cinder-3620fe2d-3de5-493d-8df0-a7983305422d-delete_snapshot" released by "delete_snapshot" :: held 2.490s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:02 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_wb7z70o1" returned: 1 in 0.519s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_wb7z70o1' failed. Not Retrying. {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 23:02:02 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bd6edf-0f88-47a0-bc1b-53cd635d6ad5]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824__0drjfr7devstack@QuobyteHD {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:02 devstack sudo[88010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824__0drjfr7devstack@QuobyteHD Apr 16 23:02:02 devstack sudo[88010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-8c8314e9-5755-4226-8825-2847cb483861 req-6e196c4d-a66f-40b3-a439-6abfef886ffa tempest-VolumesSnapshotsTestJSON-935107166 None] Acquiring lock "cinder-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-8c8314e9-5755-4226-8825-2847cb483861 req-6e196c4d-a66f-40b3-a439-6abfef886ffa tempest-VolumesSnapshotsTestJSON-935107166 None] Lock "cinder-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-8c8314e9-5755-4226-8825-2847cb483861 req-6e196c4d-a66f-40b3-a439-6abfef886ffa tempest-VolumesSnapshotsTestJSON-935107166 None] Acquiring lock "cinder-quobyte-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-8c8314e9-5755-4226-8825-2847cb483861 req-6e196c4d-a66f-40b3-a439-6abfef886ffa tempest-VolumesSnapshotsTestJSON-935107166 None] Lock "cinder-quobyte-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4" acquired by "delete_volume" :: waited 0.008s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:02 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c1d3d6-f0c0-4277-94db-40a96fd94128]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-8c8314e9-5755-4226-8825-2847cb483861 req-6e196c4d-a66f-40b3-a439-6abfef886ffa tempest-VolumesSnapshotsTestJSON-935107166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:02 devstack sudo[88010]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824__0drjfr7devstack@QuobyteHD" returned: 0 in 0.521s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:02 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] f3c20cd6-f75b-4471-a89e-2a8c84f8b824 was qcow2, converting to raw {{(pid=81971) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 23:02:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824__0drjfr7devstack@QuobyteHD /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:02 devstack sudo[88016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4 Apr 16 23:02:02 devstack sudo[88016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:02 devstack sudo[88017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824__0drjfr7devstack@QuobyteHD /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de Apr 16 23:02:02 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:03 devstack sudo[88016]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-8c8314e9-5755-4226-8825-2847cb483861 req-6e196c4d-a66f-40b3-a439-6abfef886ffa tempest-VolumesSnapshotsTestJSON-935107166 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4" returned: 0 in 0.521s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-8c8314e9-5755-4226-8825-2847cb483861 req-6e196c4d-a66f-40b3-a439-6abfef886ffa tempest-VolumesSnapshotsTestJSON-935107166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:03 devstack sudo[88029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4 Apr 16 23:02:03 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:03 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-8c8314e9-5755-4226-8825-2847cb483861 req-6e196c4d-a66f-40b3-a439-6abfef886ffa tempest-VolumesSnapshotsTestJSON-935107166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4" returned: 0 in 0.601s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:03 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-8c8314e9-5755-4226-8825-2847cb483861 req-6e196c4d-a66f-40b3-a439-6abfef886ffa tempest-VolumesSnapshotsTestJSON-935107166 None] Lock "cinder-quobyte-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4" released by "delete_volume" :: held 1.181s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:03 devstack cinder-volume[81971]: DEBUG cinder.quota [req-8c8314e9-5755-4226-8825-2847cb483861 req-6e196c4d-a66f-40b3-a439-6abfef886ffa tempest-VolumesSnapshotsTestJSON-935107166 None] Created reservations ['cf0e7d95-e51c-4ba9-8aab-b550f3e360d4', 'd84d90da-da0c-4a6a-ad32-c9e724eb0510', 'e1cf0fd7-0401-47c8-be9d-b7d3b9295895', 'ccc79684-2560-45b5-be37-d54f47734a32'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:02:03 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824__0drjfr7devstack@QuobyteHD /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de" returned: 0 in 1.202s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:03 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824__0drjfr7devstack@QuobyteHD, size 112.00 MB, duration 1.20 sec, destination /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de {{(pid=81971) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 23:02:03 devstack cinder-volume[81971]: INFO cinder.image.image_utils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Converted 112.00 MB image at 93.09 MB/s Apr 16 23:02:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-8c8314e9-5755-4226-8825-2847cb483861 req-6e196c4d-a66f-40b3-a439-6abfef886ffa tempest-VolumesSnapshotsTestJSON-935107166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-8c8314e9-5755-4226-8825-2847cb483861 req-6e196c4d-a66f-40b3-a439-6abfef886ffa tempest-VolumesSnapshotsTestJSON-935107166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-8c8314e9-5755-4226-8825-2847cb483861 req-6e196c4d-a66f-40b3-a439-6abfef886ffa tempest-VolumesSnapshotsTestJSON-935107166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:02:03 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de 1G Apr 16 23:02:03 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [req-8c8314e9-5755-4226-8825-2847cb483861 req-6e196c4d-a66f-40b3-a439-6abfef886ffa tempest-VolumesSnapshotsTestJSON-935107166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:02:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [req-8c8314e9-5755-4226-8825-2847cb483861 req-6e196c4d-a66f-40b3-a439-6abfef886ffa tempest-VolumesSnapshotsTestJSON-935107166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-8c8314e9-5755-4226-8825-2847cb483861 req-6e196c4d-a66f-40b3-a439-6abfef886ffa tempest-VolumesSnapshotsTestJSON-935107166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:03 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:02:03 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:04 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [req-8c8314e9-5755-4226-8825-2847cb483861 req-6e196c4d-a66f-40b3-a439-6abfef886ffa tempest-VolumesSnapshotsTestJSON-935107166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.481s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:04 devstack cinder-volume[81971]: DEBUG cinder.manager [req-8c8314e9-5755-4226-8825-2847cb483861 req-6e196c4d-a66f-40b3-a439-6abfef886ffa tempest-VolumesSnapshotsTestJSON-935107166 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:02:04 devstack cinder-volume[81971]: INFO cinder.volume.manager [req-8c8314e9-5755-4226-8825-2847cb483861 req-6e196c4d-a66f-40b3-a439-6abfef886ffa tempest-VolumesSnapshotsTestJSON-935107166 None] Deleted volume successfully. Apr 16 23:02:04 devstack cinder-volume[81971]: DEBUG cinder.coordination [req-8c8314e9-5755-4226-8825-2847cb483861 req-6e196c4d-a66f-40b3-a439-6abfef886ffa tempest-VolumesSnapshotsTestJSON-935107166 None] Lock "cinder-b9e4cc8d-8b8a-4a0b-b7ca-cdf1d582e6d4-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:04 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de 1G" returned: 0 in 0.636s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:04 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7cd3c6-b8f1-4921-b4d2-ba7469c481d6]: (4, 'raw') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:04 devstack sudo[88040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de Apr 16 23:02:04 devstack sudo[88040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:04 devstack cinder-volume[81971]: DEBUG oslo_service.periodic_task [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81971) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 23:02:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:02:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:02:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:04 devstack sudo[88042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:02:04 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:05 devstack sudo[88040]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de" returned: 0 in 0.736s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:05 devstack sudo[88046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de Apr 16 23:02:05 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:05 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.605s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:05 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:02:05 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de" returned: 1 in 0.687s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de' failed. Not Retrying. {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 23:02:05 devstack cinder-volume[81971]: DEBUG cinder.volume.volume_utils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Downloaded image f3c20cd6-f75b-4471-a89e-2a8c84f8b824 ((None, [{'url': 'file:///opt/stack/data/glance/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'metadata': {}}])) to volume 543b7f76-a750-4835-b911-41ab151175de successfully. {{(pid=81971) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 16 23:02:05 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Temporary image f3c20cd6-f75b-4471-a89e-2a8c84f8b824 for user 32aad6df55bd40fea95db566ae4e216c is deleted. {{(pid=81971) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 23:02:05 devstack cinder-volume[81971]: DEBUG cinder.volume.volume_utils [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Marking volume 543b7f76-a750-4835-b911-41ab151175de as bootable. {{(pid=81971) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 16 23:02:05 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:UPDATE=220,cinder:SELECT=139,cinder:INSERT=49,cinder:DELETE=21 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 23:02:05 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Copying metadata from image f3c20cd6-f75b-4471-a89e-2a8c84f8b824 to 543b7f76-a750-4835-b911-41ab151175de. {{(pid=81971) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 23:02:05 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Creating volume glance metadata for volume 543b7f76-a750-4835-b911-41ab151175de backed by image f3c20cd6-f75b-4471-a89e-2a8c84f8b824 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81971) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 23:02:06 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff2db97-27f9-4d33-bd1e-bc8d4143278d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-543b7f76-a750-4835-b911-41ab151175de', 'volume_size': 1, 'image_id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '70c7e2479fd847c6b5fabb2201f59bd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'created_at': datetime.datetime(2026, 4, 16, 20, 51, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 20, 51, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:06 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b6f43d-a914-4f68-b1fd-8ce3c986f9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:06 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Volume volume-543b7f76-a750-4835-b911-41ab151175de (543b7f76-a750-4835-b911-41ab151175de): created successfully Apr 16 23:02:06 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b6f43d-a914-4f68-b1fd-8ce3c986f9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:06 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Flow 'volume_create_manager' (b1e38207-bb87-497c-a442-e46b62b4f13e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:02:06 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-987e8ca8-6ab3-49a2-900b-332449521066 tempest-VolumesImageMetadata-1659805957 None] Created volume successfully. Apr 16 23:02:07 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-57ed71a6-bdf3-4fa1-ad6e-8c754ad6d14e tempest-VolumesImageMetadata-1659805957 None] Acquiring lock "cinder-543b7f76-a750-4835-b911-41ab151175de-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:07 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-57ed71a6-bdf3-4fa1-ad6e-8c754ad6d14e tempest-VolumesImageMetadata-1659805957 None] Lock "cinder-543b7f76-a750-4835-b911-41ab151175de-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:07 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-57ed71a6-bdf3-4fa1-ad6e-8c754ad6d14e tempest-VolumesImageMetadata-1659805957 None] Acquiring lock "cinder-quobyte-543b7f76-a750-4835-b911-41ab151175de" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:07 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-57ed71a6-bdf3-4fa1-ad6e-8c754ad6d14e tempest-VolumesImageMetadata-1659805957 None] Lock "cinder-quobyte-543b7f76-a750-4835-b911-41ab151175de" acquired by "delete_volume" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:07 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[a840488e-b6ef-4996-90ce-ada5397ac3ae]: (4, 'raw') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-57ed71a6-bdf3-4fa1-ad6e-8c754ad6d14e tempest-VolumesImageMetadata-1659805957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:07 devstack sudo[88052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de Apr 16 23:02:07 devstack sudo[88052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:07 devstack sudo[88052]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-57ed71a6-bdf3-4fa1-ad6e-8c754ad6d14e tempest-VolumesImageMetadata-1659805957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de" returned: 0 in 0.711s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-57ed71a6-bdf3-4fa1-ad6e-8c754ad6d14e tempest-VolumesImageMetadata-1659805957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:07 devstack sudo[88056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de Apr 16 23:02:07 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:08 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-514e35f2-ea73-4863-9eda-24afba79c57b tempest-GroupsTest-1703589336 None] Group tempest-Group1-1112349799: creating Apr 16 23:02:08 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-514e35f2-ea73-4863-9eda-24afba79c57b tempest-GroupsTest-1703589336 None] Group tempest-Group1-1112349799: created successfully Apr 16 23:02:08 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-514e35f2-ea73-4863-9eda-24afba79c57b tempest-GroupsTest-1703589336 None] Create group completed successfully. Apr 16 23:02:08 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-57ed71a6-bdf3-4fa1-ad6e-8c754ad6d14e tempest-VolumesImageMetadata-1659805957 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de" returned: 1 in 0.651s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-57ed71a6-bdf3-4fa1-ad6e-8c754ad6d14e tempest-VolumesImageMetadata-1659805957 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de' failed. Not Retrying. {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 23:02:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-57ed71a6-bdf3-4fa1-ad6e-8c754ad6d14e tempest-VolumesImageMetadata-1659805957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:08 devstack sudo[88061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de Apr 16 23:02:08 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:08 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-57ed71a6-bdf3-4fa1-ad6e-8c754ad6d14e tempest-VolumesImageMetadata-1659805957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-543b7f76-a750-4835-b911-41ab151175de" returned: 0 in 0.409s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:08 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-57ed71a6-bdf3-4fa1-ad6e-8c754ad6d14e tempest-VolumesImageMetadata-1659805957 None] Lock "cinder-quobyte-543b7f76-a750-4835-b911-41ab151175de" released by "delete_volume" :: held 1.825s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:08 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-57ed71a6-bdf3-4fa1-ad6e-8c754ad6d14e tempest-VolumesImageMetadata-1659805957 None] Created reservations ['cb99776a-f0f0-44ed-964e-3655ff24f1be', 'cea72e43-d776-417a-8dca-105619323670', '61885184-2317-4941-9661-384497cf6a76', '4ecf1502-c330-42b8-98bb-e6222f454b16'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:02:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-57ed71a6-bdf3-4fa1-ad6e-8c754ad6d14e tempest-VolumesImageMetadata-1659805957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-57ed71a6-bdf3-4fa1-ad6e-8c754ad6d14e tempest-VolumesImageMetadata-1659805957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:09 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-57ed71a6-bdf3-4fa1-ad6e-8c754ad6d14e tempest-VolumesImageMetadata-1659805957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:02:09 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-57ed71a6-bdf3-4fa1-ad6e-8c754ad6d14e tempest-VolumesImageMetadata-1659805957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:02:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-57ed71a6-bdf3-4fa1-ad6e-8c754ad6d14e tempest-VolumesImageMetadata-1659805957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-57ed71a6-bdf3-4fa1-ad6e-8c754ad6d14e tempest-VolumesImageMetadata-1659805957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:09 devstack sudo[88064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:02:09 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:09 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-57ed71a6-bdf3-4fa1-ad6e-8c754ad6d14e tempest-VolumesImageMetadata-1659805957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.543s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:09 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-57ed71a6-bdf3-4fa1-ad6e-8c754ad6d14e tempest-VolumesImageMetadata-1659805957 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:02:09 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-57ed71a6-bdf3-4fa1-ad6e-8c754ad6d14e tempest-VolumesImageMetadata-1659805957 None] Deleted volume successfully. Apr 16 23:02:09 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-57ed71a6-bdf3-4fa1-ad6e-8c754ad6d14e tempest-VolumesImageMetadata-1659805957 None] Lock "cinder-543b7f76-a750-4835-b911-41ab151175de-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:09 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-414ffd6a-4a6b-4928-a625-2d12164af4c5 tempest-GroupsTest-1703589336 None] Group tempest-Group2-204678254: creating Apr 16 23:02:09 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-414ffd6a-4a6b-4928-a625-2d12164af4c5 tempest-GroupsTest-1703589336 None] Group tempest-Group2-204678254: created successfully Apr 16 23:02:09 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-414ffd6a-4a6b-4928-a625-2d12164af4c5 tempest-GroupsTest-1703589336 None] Create group completed successfully. Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Flow 'volume_create_manager' (73e3f4fc-611f-4af1-ac70-65889359ab64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8161130d-b832-45a6-b0f8-5c8f3cb6635a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8161130d-b832-45a6-b0f8-5c8f3cb6635a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-374005147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=147915f5-723f-4fb8-94d4-03a5eee5d4db,host='devstack@QuobyteHD#QuobyteHD',id=d28e0304-c987-4964-be2f-3cd5613d39f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e875bdfa4bb740c1abcaf1f676e71ab8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:02:11Z,use_quota=True,user_id='21215c8f948144d79fb2062a6af5354c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d9c7828-a096-4332-be5e-067422d0c5b9),volume_type_id=2d9c7828-a096-4332-be5e-067422d0c5b9)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313f7ca7-31fd-422f-813f-ee2c73028e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313f7ca7-31fd-422f-813f-ee2c73028e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d423b2-fcdf-466c-9895-82877fe42a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d423b2-fcdf-466c-9895-82877fe42a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd28e0304-c987-4964-be2f-3cd5613d39f1', 'volume_name': 'volume-d28e0304-c987-4964-be2f-3cd5613d39f1', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee9c3d3-c60f-4ad9-8853-b51b89af94ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ee9c3d3-c60f-4ad9-8853-b51b89af94ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10b21d8-c55d-46cb-81a2-4fb5d94e2502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:11 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Volume d28e0304-c987-4964-be2f-3cd5613d39f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d28e0304-c987-4964-be2f-3cd5613d39f1', 'volume_size': 1} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=147915f5-723f-4fb8-94d4-03a5eee5d4db,created_at=2026-04-16T21:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-374005147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=147915f5-723f-4fb8-94d4-03a5eee5d4db,host='devstack@QuobyteHD#QuobyteHD',id=d28e0304-c987-4964-be2f-3cd5613d39f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e875bdfa4bb740c1abcaf1f676e71ab8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:02:11Z,use_quota=True,user_id='21215c8f948144d79fb2062a6af5354c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2d9c7828-a096-4332-be5e-067422d0c5b9),volume_type_id=2d9c7828-a096-4332-be5e-067422d0c5b9)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Creating volume d28e0304-c987-4964-be2f-3cd5613d39f1 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:02:11 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d28e0304-c987-4964-be2f-3cd5613d39f1 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:11 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d28e0304-c987-4964-be2f-3cd5613d39f1 1073741824 Apr 16 23:02:11 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Flow 'volume_create_manager' (98812a75-fa5d-431c-b072-8961f9f891f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04b8d9b-d3e3-41ad-840c-5af67f5477e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c04b8d9b-d3e3-41ad-840c-5af67f5477e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1810878032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12dab485-61bd-46d8-9ac6-3b8e05854281,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9f84742468664b488f98cb337307ad52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:02:11Z,use_quota=True,user_id='9bc85d0604ed4b408d7f8174d8041db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209fea08-c457-487a-9bcf-cf73dc057452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (209fea08-c457-487a-9bcf-cf73dc057452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5efb48cb-7c5d-43b0-9f9d-24b5af1423b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5efb48cb-7c5d-43b0-9f9d-24b5af1423b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12dab485-61bd-46d8-9ac6-3b8e05854281', 'volume_name': 'volume-12dab485-61bd-46d8-9ac6-3b8e05854281', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3795eaff-2331-4507-8524-6c9fd10b77f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3795eaff-2331-4507-8524-6c9fd10b77f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a00a09-36b6-43a9-a6fb-ef9e680a6cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:11 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Volume 12dab485-61bd-46d8-9ac6-3b8e05854281: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12dab485-61bd-46d8-9ac6-3b8e05854281', 'volume_size': 1} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:11 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d28e0304-c987-4964-be2f-3cd5613d39f1 1073741824" returned: 0 in 0.695s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d28e0304-c987-4964-be2f-3cd5613d39f1 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:11 devstack sudo[88073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d28e0304-c987-4964-be2f-3cd5613d39f1 Apr 16 23:02:11 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:12 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d28e0304-c987-4964-be2f-3cd5613d39f1" returned: 0 in 0.545s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:02:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.947s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:02:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1810878032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12dab485-61bd-46d8-9ac6-3b8e05854281,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9f84742468664b488f98cb337307ad52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:02:11Z,use_quota=True,user_id='9bc85d0604ed4b408d7f8174d8041db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:02:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Creating volume 12dab485-61bd-46d8-9ac6-3b8e05854281 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:02:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:02:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:02:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:02:12 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:02:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-12dab485-61bd-46d8-9ac6-3b8e05854281 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:12 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10b21d8-c55d-46cb-81a2-4fb5d94e2502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d28e0304-c987-4964-be2f-3cd5613d39f1', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:12 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6829293a-3ecf-43fb-80d2-9feafccf4c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:12 devstack sudo[88077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-12dab485-61bd-46d8-9ac6-3b8e05854281 1073741824 Apr 16 23:02:12 devstack sudo[88077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:12 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Volume volume-d28e0304-c987-4964-be2f-3cd5613d39f1 (d28e0304-c987-4964-be2f-3cd5613d39f1): created successfully Apr 16 23:02:12 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6829293a-3ecf-43fb-80d2-9feafccf4c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:12 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Flow 'volume_create_manager' (73e3f4fc-611f-4af1-ac70-65889359ab64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:02:12 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-9ea2977e-f5de-4577-9c77-c5dc31d9bf2f tempest-GroupsTest-1703589336 None] Created volume successfully. Apr 16 23:02:12 devstack sudo[88077]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-12dab485-61bd-46d8-9ac6-3b8e05854281 1073741824" returned: 0 in 0.593s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-12dab485-61bd-46d8-9ac6-3b8e05854281 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:13 devstack sudo[88082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-12dab485-61bd-46d8-9ac6-3b8e05854281 Apr 16 23:02:13 devstack sudo[88082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:13 devstack sudo[88082]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-12dab485-61bd-46d8-9ac6-3b8e05854281" returned: 0 in 0.709s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:02:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:13 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b466edc4-9a71-46d6-b0df-e9c238516c1e tempest-GroupsTest-1703589336 None] Acquiring lock "cinder-quobyte-d28e0304-c987-4964-be2f-3cd5613d39f1" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a00a09-36b6-43a9-a6fb-ef9e680a6cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12dab485-61bd-46d8-9ac6-3b8e05854281', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61bfd57-9834-40aa-90aa-adc38b44d8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:13 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Volume volume-12dab485-61bd-46d8-9ac6-3b8e05854281 (12dab485-61bd-46d8-9ac6-3b8e05854281): created successfully Apr 16 23:02:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61bfd57-9834-40aa-90aa-adc38b44d8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Flow 'volume_create_manager' (98812a75-fa5d-431c-b072-8961f9f891f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:02:13 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b466edc4-9a71-46d6-b0df-e9c238516c1e tempest-GroupsTest-1703589336 None] Lock "cinder-quobyte-d28e0304-c987-4964-be2f-3cd5613d39f1" acquired by "delete_volume" :: waited 0.042s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:13 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-0f80647c-c3bc-4293-91b2-884649229351 tempest-VolumesGetTest-2085981255 None] Created volume successfully. Apr 16 23:02:13 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0c081c-42be-45ec-bf92-43a90673848d]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b466edc4-9a71-46d6-b0df-e9c238516c1e tempest-GroupsTest-1703589336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d28e0304-c987-4964-be2f-3cd5613d39f1 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:13 devstack sudo[88085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d28e0304-c987-4964-be2f-3cd5613d39f1 Apr 16 23:02:13 devstack sudo[88085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:14 devstack sudo[88085]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b466edc4-9a71-46d6-b0df-e9c238516c1e tempest-GroupsTest-1703589336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d28e0304-c987-4964-be2f-3cd5613d39f1" returned: 0 in 0.710s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b466edc4-9a71-46d6-b0df-e9c238516c1e tempest-GroupsTest-1703589336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d28e0304-c987-4964-be2f-3cd5613d39f1 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:14 devstack sudo[88090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d28e0304-c987-4964-be2f-3cd5613d39f1 Apr 16 23:02:14 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:15 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b466edc4-9a71-46d6-b0df-e9c238516c1e tempest-GroupsTest-1703589336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d28e0304-c987-4964-be2f-3cd5613d39f1" returned: 0 in 0.702s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b466edc4-9a71-46d6-b0df-e9c238516c1e tempest-GroupsTest-1703589336 None] Lock "cinder-quobyte-d28e0304-c987-4964-be2f-3cd5613d39f1" released by "delete_volume" :: held 1.449s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:INSERT=57,cinder:SELECT=147,cinder:UPDATE=175,cinder:DELETE=12 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-b466edc4-9a71-46d6-b0df-e9c238516c1e tempest-GroupsTest-1703589336 None] Created reservations ['768fc345-94a7-4aaa-9fa1-f4147fa47a62'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:02:15 devstack cinder-volume[81971]: WARNING cinder.quota [None req-b466edc4-9a71-46d6-b0df-e9c238516c1e tempest-GroupsTest-1703589336 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1207979668 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1207979668, it is now deprecated. Please use the default quota class for default quota. Apr 16 23:02:15 devstack cinder-volume[81971]: WARNING cinder.quota [None req-b466edc4-9a71-46d6-b0df-e9c238516c1e tempest-GroupsTest-1703589336 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1207979668 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1207979668, it is now deprecated. Please use the default quota class for default quota. Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Flow 'volume_create_manager' (acde7b12-aa57-45af-b2a2-22a53ea8556e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45402f72-7cfe-4298-8579-9807b27a889e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45402f72-7cfe-4298-8579-9807b27a889e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:02:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-538651613',display_name='tempest-VolumesGetTest-Volume-1630494550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=085dfc04-fd61-4f01-98af-59456973a889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f84742468664b488f98cb337307ad52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:02:15Z,use_quota=True,user_id='9bc85d0604ed4b408d7f8174d8041db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa7e0686-2e15-4822-8461-712f99f930df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa7e0686-2e15-4822-8461-712f99f930df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2641b9-1ae2-40fa-84d4-f885ffd3fdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2641b9-1ae2-40fa-84d4-f885ffd3fdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '085dfc04-fd61-4f01-98af-59456973a889', 'volume_name': 'volume-085dfc04-fd61-4f01-98af-59456973a889', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5822c15-ffcf-4c3d-9257-7b3ea070b4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5822c15-ffcf-4c3d-9257-7b3ea070b4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f27c824e-bbb5-4f30-b1df-165ff9d3982c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:15 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Volume 085dfc04-fd61-4f01-98af-59456973a889: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-085dfc04-fd61-4f01-98af-59456973a889', 'volume_size': 1} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:02:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-538651613',display_name='tempest-VolumesGetTest-Volume-1630494550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=085dfc04-fd61-4f01-98af-59456973a889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f84742468664b488f98cb337307ad52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:02:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:02:15Z,use_quota=True,user_id='9bc85d0604ed4b408d7f8174d8041db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Creating volume 085dfc04-fd61-4f01-98af-59456973a889 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:02:15 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-085dfc04-fd61-4f01-98af-59456973a889 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-b466edc4-9a71-46d6-b0df-e9c238516c1e tempest-GroupsTest-1703589336 None] Created reservations ['77dad22d-951d-46e3-ba79-9aa65890d21e', '89b9843b-5090-4e50-9276-71a30fb82508', '9976502a-89b8-4566-9258-e4b80bf46363', 'f9a1f85b-07e4-4d6d-89f5-0b7e5e55554f'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:02:15 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-085dfc04-fd61-4f01-98af-59456973a889 1073741824 Apr 16 23:02:15 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b466edc4-9a71-46d6-b0df-e9c238516c1e tempest-GroupsTest-1703589336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b466edc4-9a71-46d6-b0df-e9c238516c1e tempest-GroupsTest-1703589336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b466edc4-9a71-46d6-b0df-e9c238516c1e tempest-GroupsTest-1703589336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b466edc4-9a71-46d6-b0df-e9c238516c1e tempest-GroupsTest-1703589336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b466edc4-9a71-46d6-b0df-e9c238516c1e tempest-GroupsTest-1703589336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b466edc4-9a71-46d6-b0df-e9c238516c1e tempest-GroupsTest-1703589336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:15 devstack sudo[88095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:02:15 devstack sudo[88095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:16 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-9eed729c-38d4-44c5-8fd8-6801da6dabf4 tempest-GroupsTest-1703589336 None] Created reservations ['a8e63231-7dbc-4701-9812-c6288fbcf86b'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:02:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9eed729c-38d4-44c5-8fd8-6801da6dabf4 tempest-GroupsTest-1703589336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9eed729c-38d4-44c5-8fd8-6801da6dabf4 tempest-GroupsTest-1703589336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:16 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9eed729c-38d4-44c5-8fd8-6801da6dabf4 tempest-GroupsTest-1703589336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:02:16 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9eed729c-38d4-44c5-8fd8-6801da6dabf4 tempest-GroupsTest-1703589336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:02:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9eed729c-38d4-44c5-8fd8-6801da6dabf4 tempest-GroupsTest-1703589336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9eed729c-38d4-44c5-8fd8-6801da6dabf4 tempest-GroupsTest-1703589336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:16 devstack sudo[88100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:02:16 devstack sudo[88100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:16 devstack sudo[88095]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b466edc4-9a71-46d6-b0df-e9c238516c1e tempest-GroupsTest-1703589336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.621s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:16 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-b466edc4-9a71-46d6-b0df-e9c238516c1e tempest-GroupsTest-1703589336 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:02:16 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-085dfc04-fd61-4f01-98af-59456973a889 1073741824" returned: 0 in 0.788s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:16 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-b466edc4-9a71-46d6-b0df-e9c238516c1e tempest-GroupsTest-1703589336 None] Delete group completed successfully. Apr 16 23:02:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-085dfc04-fd61-4f01-98af-59456973a889 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:16 devstack sudo[88103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-085dfc04-fd61-4f01-98af-59456973a889 Apr 16 23:02:16 devstack sudo[88103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:16 devstack sudo[88100]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9eed729c-38d4-44c5-8fd8-6801da6dabf4 tempest-GroupsTest-1703589336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.546s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:16 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-9eed729c-38d4-44c5-8fd8-6801da6dabf4 tempest-GroupsTest-1703589336 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:02:16 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-9eed729c-38d4-44c5-8fd8-6801da6dabf4 tempest-GroupsTest-1703589336 None] Delete group completed successfully. Apr 16 23:02:16 devstack sudo[88103]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-085dfc04-fd61-4f01-98af-59456973a889" returned: 0 in 0.559s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:16 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:02:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:16 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f27c824e-bbb5-4f30-b1df-165ff9d3982c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-085dfc04-fd61-4f01-98af-59456973a889', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:16 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675f6dee-82bb-4bf0-9d75-2b51933c1dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:16 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Volume volume-085dfc04-fd61-4f01-98af-59456973a889 (085dfc04-fd61-4f01-98af-59456973a889): created successfully Apr 16 23:02:16 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675f6dee-82bb-4bf0-9d75-2b51933c1dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:16 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Flow 'volume_create_manager' (acde7b12-aa57-45af-b2a2-22a53ea8556e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:02:16 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-e47c4b3b-ee30-4581-b2b6-020e8a86b66b tempest-VolumesGetTest-2085981255 None] Created volume successfully. Apr 16 23:02:17 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-018b444f-739a-49a0-a952-7f9ceb561d22 tempest-VolumesGetTest-2085981255 None] Acquiring lock "cinder-085dfc04-fd61-4f01-98af-59456973a889-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:17 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-018b444f-739a-49a0-a952-7f9ceb561d22 tempest-VolumesGetTest-2085981255 None] Lock "cinder-085dfc04-fd61-4f01-98af-59456973a889-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:17 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-018b444f-739a-49a0-a952-7f9ceb561d22 tempest-VolumesGetTest-2085981255 None] Acquiring lock "cinder-quobyte-085dfc04-fd61-4f01-98af-59456973a889" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:17 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-018b444f-739a-49a0-a952-7f9ceb561d22 tempest-VolumesGetTest-2085981255 None] Lock "cinder-quobyte-085dfc04-fd61-4f01-98af-59456973a889" acquired by "delete_volume" :: waited 0.021s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:17 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[642bfbab-605d-495a-a9a0-1dc0fd1f0b20]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-018b444f-739a-49a0-a952-7f9ceb561d22 tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-085dfc04-fd61-4f01-98af-59456973a889 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:17 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-83b00db7-5d8e-4d14-a042-6c2e55a7891e tempest-GroupsTest-1703589336 None] Group tempest-GroupsTest-Group-1565979221: creating Apr 16 23:02:17 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-83b00db7-5d8e-4d14-a042-6c2e55a7891e tempest-GroupsTest-1703589336 None] Group tempest-GroupsTest-Group-1565979221: created successfully Apr 16 23:02:17 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-83b00db7-5d8e-4d14-a042-6c2e55a7891e tempest-GroupsTest-1703589336 None] Create group completed successfully. Apr 16 23:02:17 devstack sudo[88107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-085dfc04-fd61-4f01-98af-59456973a889 Apr 16 23:02:17 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:18 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-018b444f-739a-49a0-a952-7f9ceb561d22 tempest-VolumesGetTest-2085981255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-085dfc04-fd61-4f01-98af-59456973a889" returned: 0 in 0.613s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-018b444f-739a-49a0-a952-7f9ceb561d22 tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-085dfc04-fd61-4f01-98af-59456973a889 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:18 devstack sudo[88112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-085dfc04-fd61-4f01-98af-59456973a889 Apr 16 23:02:18 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:19 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-018b444f-739a-49a0-a952-7f9ceb561d22 tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-085dfc04-fd61-4f01-98af-59456973a889" returned: 0 in 0.682s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-018b444f-739a-49a0-a952-7f9ceb561d22 tempest-VolumesGetTest-2085981255 None] Lock "cinder-quobyte-085dfc04-fd61-4f01-98af-59456973a889" released by "delete_volume" :: held 1.334s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-018b444f-739a-49a0-a952-7f9ceb561d22 tempest-VolumesGetTest-2085981255 None] Created reservations ['4d56bfee-3133-459f-84f4-68121761a1fa', '4d6c3fcc-7d26-419f-85ce-33dce957d6a4', 'bf33d351-c0b4-4b7c-8ecf-6956d6349aa8', '2c161566-72b1-4385-9f1c-b38ca50eaf8b'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Flow 'volume_create_manager' (57fdd5c9-8d39-4954-bc32-c9ffdd7f9cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0429843-07ae-448c-ab9d-889790230f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0429843-07ae-448c-ab9d-889790230f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1535027308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7fee8238-9e33-4221-bd90-8246acdf50df,host='devstack@QuobyteHD#QuobyteHD',id=212d2d27-e716-4e96-814a-260ba2e5dde7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e875bdfa4bb740c1abcaf1f676e71ab8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:02:19Z,use_quota=True,user_id='21215c8f948144d79fb2062a6af5354c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(739f532e-8b04-4840-baba-b7f0127aca6d),volume_type_id=739f532e-8b04-4840-baba-b7f0127aca6d)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e384a77-9224-4c2e-aa5b-90789201820c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e384a77-9224-4c2e-aa5b-90789201820c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4a6725-992e-407e-a838-bebe424c545b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c4a6725-992e-407e-a838-bebe424c545b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '212d2d27-e716-4e96-814a-260ba2e5dde7', 'volume_name': 'volume-212d2d27-e716-4e96-814a-260ba2e5dde7', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77f1cdb-bb57-4f0a-8b12-bc977c732fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c77f1cdb-bb57-4f0a-8b12-bc977c732fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a4e044-d461-4ee4-a5e6-6eb1877e9887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:19 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Volume 212d2d27-e716-4e96-814a-260ba2e5dde7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-212d2d27-e716-4e96-814a-260ba2e5dde7', 'volume_size': 1} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7fee8238-9e33-4221-bd90-8246acdf50df,created_at=2026-04-16T21:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1535027308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7fee8238-9e33-4221-bd90-8246acdf50df,host='devstack@QuobyteHD#QuobyteHD',id=212d2d27-e716-4e96-814a-260ba2e5dde7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e875bdfa4bb740c1abcaf1f676e71ab8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:02:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:02:19Z,use_quota=True,user_id='21215c8f948144d79fb2062a6af5354c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(739f532e-8b04-4840-baba-b7f0127aca6d),volume_type_id=739f532e-8b04-4840-baba-b7f0127aca6d)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Creating volume 212d2d27-e716-4e96-814a-260ba2e5dde7 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:02:19 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-212d2d27-e716-4e96-814a-260ba2e5dde7 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:19 devstack sudo[88115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-212d2d27-e716-4e96-814a-260ba2e5dde7 1073741824 Apr 16 23:02:19 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-018b444f-739a-49a0-a952-7f9ceb561d22 tempest-VolumesGetTest-2085981255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-018b444f-739a-49a0-a952-7f9ceb561d22 tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-018b444f-739a-49a0-a952-7f9ceb561d22 tempest-VolumesGetTest-2085981255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-018b444f-739a-49a0-a952-7f9ceb561d22 tempest-VolumesGetTest-2085981255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-018b444f-739a-49a0-a952-7f9ceb561d22 tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-018b444f-739a-49a0-a952-7f9ceb561d22 tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:19 devstack sudo[88117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:02:19 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:19 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-018b444f-739a-49a0-a952-7f9ceb561d22 tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.608s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-018b444f-739a-49a0-a952-7f9ceb561d22 tempest-VolumesGetTest-2085981255 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:02:19 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:19 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-018b444f-739a-49a0-a952-7f9ceb561d22 tempest-VolumesGetTest-2085981255 None] Deleted volume successfully. Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-212d2d27-e716-4e96-814a-260ba2e5dde7 1073741824" returned: 0 in 0.710s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-018b444f-739a-49a0-a952-7f9ceb561d22 tempest-VolumesGetTest-2085981255 None] Lock "cinder-085dfc04-fd61-4f01-98af-59456973a889-delete_volume" released by "delete_volume" :: held 2.294s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-212d2d27-e716-4e96-814a-260ba2e5dde7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:19 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f91c5df5-a9b7-400b-bb1f-2809ac2da554 tempest-VolumesGetTest-2085981255 None] Acquiring lock "cinder-12dab485-61bd-46d8-9ac6-3b8e05854281-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:20 devstack sudo[88123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-212d2d27-e716-4e96-814a-260ba2e5dde7 Apr 16 23:02:20 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:20 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f91c5df5-a9b7-400b-bb1f-2809ac2da554 tempest-VolumesGetTest-2085981255 None] Lock "cinder-12dab485-61bd-46d8-9ac6-3b8e05854281-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:20 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f91c5df5-a9b7-400b-bb1f-2809ac2da554 tempest-VolumesGetTest-2085981255 None] Acquiring lock "cinder-quobyte-12dab485-61bd-46d8-9ac6-3b8e05854281" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:20 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f91c5df5-a9b7-400b-bb1f-2809ac2da554 tempest-VolumesGetTest-2085981255 None] Lock "cinder-quobyte-12dab485-61bd-46d8-9ac6-3b8e05854281" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:20 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88c845d-f22e-42e2-a9f3-7676e495399f]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f91c5df5-a9b7-400b-bb1f-2809ac2da554 tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-12dab485-61bd-46d8-9ac6-3b8e05854281 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:20 devstack sudo[88125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-12dab485-61bd-46d8-9ac6-3b8e05854281 Apr 16 23:02:20 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:20 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-212d2d27-e716-4e96-814a-260ba2e5dde7" returned: 0 in 0.559s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:20 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:02:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a4e044-d461-4ee4-a5e6-6eb1877e9887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-212d2d27-e716-4e96-814a-260ba2e5dde7', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4de4e2d-4643-47c4-acbb-417b3fa1c58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:20 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Volume volume-212d2d27-e716-4e96-814a-260ba2e5dde7 (212d2d27-e716-4e96-814a-260ba2e5dde7): created successfully Apr 16 23:02:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4de4e2d-4643-47c4-acbb-417b3fa1c58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Flow 'volume_create_manager' (57fdd5c9-8d39-4954-bc32-c9ffdd7f9cca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:02:20 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-b1cc6909-d19c-4a46-bdad-5733d7ce1998 tempest-GroupsTest-1703589336 None] Created volume successfully. Apr 16 23:02:20 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f91c5df5-a9b7-400b-bb1f-2809ac2da554 tempest-VolumesGetTest-2085981255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-12dab485-61bd-46d8-9ac6-3b8e05854281" returned: 0 in 0.578s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f91c5df5-a9b7-400b-bb1f-2809ac2da554 tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-12dab485-61bd-46d8-9ac6-3b8e05854281 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:20 devstack sudo[88131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-12dab485-61bd-46d8-9ac6-3b8e05854281 Apr 16 23:02:20 devstack sudo[88131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:21 devstack sudo[88131]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f91c5df5-a9b7-400b-bb1f-2809ac2da554 tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-12dab485-61bd-46d8-9ac6-3b8e05854281" returned: 0 in 0.491s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f91c5df5-a9b7-400b-bb1f-2809ac2da554 tempest-VolumesGetTest-2085981255 None] Lock "cinder-quobyte-12dab485-61bd-46d8-9ac6-3b8e05854281" released by "delete_volume" :: held 1.102s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-f91c5df5-a9b7-400b-bb1f-2809ac2da554 tempest-VolumesGetTest-2085981255 None] Created reservations ['a795ff7b-2838-4c04-952b-c2e5be83099b', '21cc2a73-1930-4e45-aab7-42f0b50ce1a1', 'f5892add-84ea-4e2d-ad1f-1a1702e94f0a', 'afba86e1-01c6-40a4-9140-b18044db960e'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f91c5df5-a9b7-400b-bb1f-2809ac2da554 tempest-VolumesGetTest-2085981255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f91c5df5-a9b7-400b-bb1f-2809ac2da554 tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-f91c5df5-a9b7-400b-bb1f-2809ac2da554 tempest-VolumesGetTest-2085981255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-f91c5df5-a9b7-400b-bb1f-2809ac2da554 tempest-VolumesGetTest-2085981255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f91c5df5-a9b7-400b-bb1f-2809ac2da554 tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f91c5df5-a9b7-400b-bb1f-2809ac2da554 tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:21 devstack sudo[88134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:02:21 devstack sudo[88134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Flow 'volume_create_manager' (718f9067-5e3a-4487-8a78-75a4bac460dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd772bd3-840d-496e-8be2-959baa096f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd772bd3-840d-496e-8be2-959baa096f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-122403863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7fee8238-9e33-4221-bd90-8246acdf50df,host='devstack@QuobyteHD#QuobyteHD',id=9f479011-6429-452b-b7ae-05ed4b03da0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e875bdfa4bb740c1abcaf1f676e71ab8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:02:22Z,use_quota=True,user_id='21215c8f948144d79fb2062a6af5354c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(739f532e-8b04-4840-baba-b7f0127aca6d),volume_type_id=739f532e-8b04-4840-baba-b7f0127aca6d)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31847ea7-254c-4a8e-b4fb-78093b7ba279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31847ea7-254c-4a8e-b4fb-78093b7ba279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ee5c9f-d525-4662-afe7-58d7e6f5bcb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94ee5c9f-d525-4662-afe7-58d7e6f5bcb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f479011-6429-452b-b7ae-05ed4b03da0d', 'volume_name': 'volume-9f479011-6429-452b-b7ae-05ed4b03da0d', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5eb5ad9-cb49-4449-b933-4ec05deaf3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5eb5ad9-cb49-4449-b933-4ec05deaf3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69fe5fd3-76e5-44d0-8712-af93986b0cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:21 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Volume 9f479011-6429-452b-b7ae-05ed4b03da0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f479011-6429-452b-b7ae-05ed4b03da0d', 'volume_size': 1} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7fee8238-9e33-4221-bd90-8246acdf50df,created_at=2026-04-16T21:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-122403863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7fee8238-9e33-4221-bd90-8246acdf50df,host='devstack@QuobyteHD#QuobyteHD',id=9f479011-6429-452b-b7ae-05ed4b03da0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e875bdfa4bb740c1abcaf1f676e71ab8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:02:22Z,use_quota=True,user_id='21215c8f948144d79fb2062a6af5354c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(739f532e-8b04-4840-baba-b7f0127aca6d),volume_type_id=739f532e-8b04-4840-baba-b7f0127aca6d)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Creating volume 9f479011-6429-452b-b7ae-05ed4b03da0d {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:02:21 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f479011-6429-452b-b7ae-05ed4b03da0d 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:21 devstack sudo[88134]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:21 devstack sudo[88137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f479011-6429-452b-b7ae-05ed4b03da0d 1073741824 Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f91c5df5-a9b7-400b-bb1f-2809ac2da554 tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.535s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:21 devstack sudo[88137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-f91c5df5-a9b7-400b-bb1f-2809ac2da554 tempest-VolumesGetTest-2085981255 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:02:21 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-f91c5df5-a9b7-400b-bb1f-2809ac2da554 tempest-VolumesGetTest-2085981255 None] Deleted volume successfully. Apr 16 23:02:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f91c5df5-a9b7-400b-bb1f-2809ac2da554 tempest-VolumesGetTest-2085981255 None] Lock "cinder-12dab485-61bd-46d8-9ac6-3b8e05854281-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:22 devstack sudo[88137]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f479011-6429-452b-b7ae-05ed4b03da0d 1073741824" returned: 0 in 0.706s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f479011-6429-452b-b7ae-05ed4b03da0d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:22 devstack sudo[88143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f479011-6429-452b-b7ae-05ed4b03da0d Apr 16 23:02:22 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:22 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:02:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Flow 'volume_create_manager' (d808ba0a-78f8-441d-9d16-f2acf916ddea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:02:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7eeee6e-4837-4586-b272-29538cd427cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7eeee6e-4837-4586-b272-29538cd427cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1605298138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb63f012-13fd-44d3-b6b2-922f62ce0a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f84742468664b488f98cb337307ad52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:02:23Z,use_quota=True,user_id='9bc85d0604ed4b408d7f8174d8041db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4242bda7-f83e-434b-90a2-4d923a35061b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4242bda7-f83e-434b-90a2-4d923a35061b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3379f57c-a74c-4c51-aca7-e4b9a16bc925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3379f57c-a74c-4c51-aca7-e4b9a16bc925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb63f012-13fd-44d3-b6b2-922f62ce0a01', 'volume_name': 'volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb12f1f-21aa-41b9-a38b-dfd15b6097c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb12f1f-21aa-41b9-a38b-dfd15b6097c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7629de4-b400-4780-a7f6-d2b484d6c71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:22 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Volume fb63f012-13fd-44d3-b6b2-922f62ce0a01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01', 'volume_size': 1} Apr 16 23:02:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:23 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f479011-6429-452b-b7ae-05ed4b03da0d" returned: 0 in 0.546s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:02:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.360s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1605298138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb63f012-13fd-44d3-b6b2-922f62ce0a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f84742468664b488f98cb337307ad52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:02:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:02:23Z,use_quota=True,user_id='9bc85d0604ed4b408d7f8174d8041db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:02:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Creating volume fb63f012-13fd-44d3-b6b2-922f62ce0a01 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:02:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:02:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:02:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:02:23 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:02:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:23 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69fe5fd3-76e5-44d0-8712-af93986b0cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f479011-6429-452b-b7ae-05ed4b03da0d', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:23 devstack sudo[88146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01 1073741824 Apr 16 23:02:23 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:23 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4ded9d-ab78-4026-a327-b45d00b13d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:23 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Volume volume-9f479011-6429-452b-b7ae-05ed4b03da0d (9f479011-6429-452b-b7ae-05ed4b03da0d): created successfully Apr 16 23:02:23 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba4ded9d-ab78-4026-a327-b45d00b13d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:23 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Flow 'volume_create_manager' (718f9067-5e3a-4487-8a78-75a4bac460dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:02:23 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-78e7f45f-d3d8-4993-b7bd-a5e685242554 tempest-GroupsTest-1703589336 None] Created volume successfully. Apr 16 23:02:23 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01 1073741824" returned: 0 in 0.651s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:23 devstack sudo[88151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01 Apr 16 23:02:23 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:23 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-6b559c5a-f13a-4e8f-8b29-7f3100b3466a tempest-GroupsTest-1703589336 None] Update group completed successfully. Apr 16 23:02:24 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01" returned: 0 in 0.699s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:24 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] <== create_volume: return (1385ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:02:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:24 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7629de4-b400-4780-a7f6-d2b484d6c71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:24 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (885ab81c-2aa2-4464-87a8-eb23f53be89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:24 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Volume volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01 (fb63f012-13fd-44d3-b6b2-922f62ce0a01): created successfully Apr 16 23:02:24 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (885ab81c-2aa2-4464-87a8-eb23f53be89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:24 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Flow 'volume_create_manager' (d808ba0a-78f8-441d-9d16-f2acf916ddea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:02:24 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-50e78176-d02b-45dd-b1ea-ac6e9831cd8b tempest-VolumesGetTest-2085981255 None] Created volume successfully. Apr 16 23:02:25 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:02:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Flow 'volume_create_manager' (e7f662a8-2f6c-4adf-a327-3a84676f71c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:02:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a7b881a-65db-441d-846e-e1c923bb6fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a7b881a-65db-441d-846e-e1c923bb6fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-924027953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb49e761-6d6e-447d-92b0-6be7a10dc9b0,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9f84742468664b488f98cb337307ad52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=fb63f012-13fd-44d3-b6b2-922f62ce0a01,status='creating',terminated_at=None,updated_at=2026-04-16T21:02:25Z,use_quota=True,user_id='9bc85d0604ed4b408d7f8174d8041db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c1b8e9d-d702-46a9-9801-f6da8f1a3149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c1b8e9d-d702-46a9-9801-f6da8f1a3149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672bdfcc-254c-48c1-9fc5-f4afe3167de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672bdfcc-254c-48c1-9fc5-f4afe3167de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bb49e761-6d6e-447d-92b0-6be7a10dc9b0', 'volume_name': 'volume-bb49e761-6d6e-447d-92b0-6be7a10dc9b0', 'volume_size': 1, 'source_volid': 'fb63f012-13fd-44d3-b6b2-922f62ce0a01', 'source_volstatus': 'available'}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab686b1b-b431-4704-aea7-ea25720314dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab686b1b-b431-4704-aea7-ea25720314dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a71a21-b2a7-4cb1-8a99-ebe2d6a5fe2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:25 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Volume bb49e761-6d6e-447d-92b0-6be7a10dc9b0: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bb49e761-6d6e-447d-92b0-6be7a10dc9b0', 'volume_size': 1, 'source_volid': 'fb63f012-13fd-44d3-b6b2-922f62ce0a01', 'source_volstatus': 'available'} Apr 16 23:02:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:25 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Cloning volume fb63f012-13fd-44d3-b6b2-922f62ce0a01 to volume bb49e761-6d6e-447d-92b0-6be7a10dc9b0 Apr 16 23:02:25 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Creating offline snapshot 7f7663e4-a292-4aad-98e9-90bb0de349d5 of volume fb63f012-13fd-44d3-b6b2-922f62ce0a01 {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:02:25 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[e090645f-0767-4507-bf77-927c5bf75e24]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:25 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-e70c8741-247a-4dbe-b6b4-3bdfd55f3477 tempest-GroupsTest-1703589336 None] Update group completed successfully. Apr 16 23:02:25 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01 Apr 16 23:02:25 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:25 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01" returned: 0 in 0.599s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.7f7663e4-a292-4aad-98e9-90bb0de349d5 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:26 devstack sudo[88159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.7f7663e4-a292-4aad-98e9-90bb0de349d5 1G Apr 16 23:02:26 devstack sudo[88159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] Acquiring lock "cinder-quobyte-212d2d27-e716-4e96-814a-260ba2e5dde7" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] Lock "cinder-quobyte-212d2d27-e716-4e96-814a-260ba2e5dde7" acquired by "delete_volume" :: waited 0.019s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:26 devstack sudo[88159]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.7f7663e4-a292-4aad-98e9-90bb0de349d5 1G" returned: 0 in 0.811s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.7f7663e4-a292-4aad-98e9-90bb0de349d5 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:26 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f00512-a086-4d08-8476-56df347d03f2]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:26 devstack sudo[88164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.7f7663e4-a292-4aad-98e9-90bb0de349d5 Apr 16 23:02:26 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-212d2d27-e716-4e96-814a-260ba2e5dde7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:26 devstack sudo[88166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-212d2d27-e716-4e96-814a-260ba2e5dde7 Apr 16 23:02:26 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:27 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.7f7663e4-a292-4aad-98e9-90bb0de349d5" returned: 0 in 0.538s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:27 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.7f7663e4-a292-4aad-98e9-90bb0de349d5 is being set with open permissions: ugo+rw Apr 16 23:02:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.7f7663e4-a292-4aad-98e9-90bb0de349d5 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:27 devstack sudo[88171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.7f7663e4-a292-4aad-98e9-90bb0de349d5 Apr 16 23:02:27 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:27 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-212d2d27-e716-4e96-814a-260ba2e5dde7" returned: 0 in 0.676s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-212d2d27-e716-4e96-814a-260ba2e5dde7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:27 devstack sudo[88176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-212d2d27-e716-4e96-814a-260ba2e5dde7 Apr 16 23:02:27 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:27 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.7f7663e4-a292-4aad-98e9-90bb0de349d5" returned: 0 in 0.488s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:27 devstack sudo[88180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.info Apr 16 23:02:27 devstack sudo[88180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:28 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-212d2d27-e716-4e96-814a-260ba2e5dde7" returned: 0 in 0.572s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:28 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] Lock "cinder-quobyte-212d2d27-e716-4e96-814a-260ba2e5dde7" released by "delete_volume" :: held 1.298s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:28 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] Acquiring lock "cinder-quobyte-9f479011-6429-452b-b7ae-05ed4b03da0d" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:28 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] Lock "cinder-quobyte-9f479011-6429-452b-b7ae-05ed4b03da0d" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:28 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[680d8f62-a731-4722-8894-825d3e7cd884]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f479011-6429-452b-b7ae-05ed4b03da0d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:28 devstack sudo[88183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f479011-6429-452b-b7ae-05ed4b03da0d Apr 16 23:02:28 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:28 devstack sudo[88180]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.info" returned: 0 in 0.639s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:28 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.info is being set with open permissions: ugo+rw Apr 16 23:02:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:28 devstack sudo[88186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.info Apr 16 23:02:28 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:28 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f479011-6429-452b-b7ae-05ed4b03da0d" returned: 0 in 0.713s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f479011-6429-452b-b7ae-05ed4b03da0d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:28 devstack sudo[88191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f479011-6429-452b-b7ae-05ed4b03da0d Apr 16 23:02:28 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:29 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.info" returned: 0 in 0.549s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Acquiring lock "cinder-quobyte-bb49e761-6d6e-447d-92b0-6be7a10dc9b0" by "_copy_volume_from_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Lock "cinder-quobyte-bb49e761-6d6e-447d-92b0-6be7a10dc9b0" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] snapshot: 7f7663e4-a292-4aad-98e9-90bb0de349d5, volume: bb49e761-6d6e-447d-92b0-6be7a10dc9b0, {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec018204-adb0-4fc0-93b4-afd623bce984]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.7f7663e4-a292-4aad-98e9-90bb0de349d5 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:29 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.7f7663e4-a292-4aad-98e9-90bb0de349d5 Apr 16 23:02:29 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:29 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9f479011-6429-452b-b7ae-05ed4b03da0d" returned: 0 in 0.582s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] Lock "cinder-quobyte-9f479011-6429-452b-b7ae-05ed4b03da0d" released by "delete_volume" :: held 1.324s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] Created reservations ['7c0bc841-7ea5-4221-94cc-9e70b029e087'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:02:29 devstack cinder-volume[81971]: WARNING cinder.quota [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-464648839 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-464648839, it is now deprecated. Please use the default quota class for default quota. Apr 16 23:02:29 devstack cinder-volume[81971]: WARNING cinder.quota [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-464648839 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-464648839, it is now deprecated. Please use the default quota class for default quota. Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] Created reservations ['b39c9173-70ae-404f-84b1-7c4f9436744c', 'd8fb7fd1-9605-45ac-9a2f-129ab339d93a', 'c26786f5-b4ee-4447-a489-a1ee8bf7b861', 'f0291f1d-5394-4590-b264-e406d16d9f7d'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] Created reservations ['2912561d-6ad4-4ec6-8fcb-2cf570f83ac5', '287dbe28-4549-4870-ad36-069546743616', '7a227958-55aa-4327-b13e-bfb50616e616', '7de65be1-531e-4ff8-92c2-5ff2ab6fff68'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:02:29 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.7f7663e4-a292-4aad-98e9-90bb0de349d5" returned: 0 in 0.683s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01 {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Creating direct copy from snapshot {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccce1d5-5d3b-48c8-bff7-3704c9935a67]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:29 devstack sudo[88201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:02:29 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:29 devstack sudo[88200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01 Apr 16 23:02:29 devstack sudo[88200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:30 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.587s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:30 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:02:30 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-3309aae5-b978-4f6b-ab73-54aae57cab27 tempest-GroupsTest-1703589336 None] Delete group completed successfully. Apr 16 23:02:30 devstack sudo[88200]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01" returned: 0 in 0.942s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:30 devstack cinder-volume[81971]: DEBUG cinder.utils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Path /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bb49e761-6d6e-447d-92b0-6be7a10dc9b0 not found in is_blk_device check {{(pid=81971) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 23:02:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bb49e761-6d6e-447d-92b0-6be7a10dc9b0 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:30 devstack sudo[88208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bb49e761-6d6e-447d-92b0-6be7a10dc9b0 Apr 16 23:02:30 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:33 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bb49e761-6d6e-447d-92b0-6be7a10dc9b0" returned: 0 in 3.076s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:33 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8c49cf-1e2b-4669-a945-3bb6e28018b7]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:33 devstack sudo[88221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01 Apr 16 23:02:33 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:34 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01" returned: 0 in 0.714s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:34 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Image conversion details: src /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01, size 1024.00 MB, duration 3.08 sec, destination /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bb49e761-6d6e-447d-92b0-6be7a10dc9b0 {{(pid=81971) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 23:02:34 devstack cinder-volume[81971]: INFO cinder.image.image_utils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Converted 1024.00 MB image at 332.77 MB/s Apr 16 23:02:34 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bb49e761-6d6e-447d-92b0-6be7a10dc9b0 is being set with open permissions: ugo+rw Apr 16 23:02:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bb49e761-6d6e-447d-92b0-6be7a10dc9b0 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:34 devstack sudo[88226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bb49e761-6d6e-447d-92b0-6be7a10dc9b0 Apr 16 23:02:34 devstack sudo[88226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:35 devstack sudo[88226]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bb49e761-6d6e-447d-92b0-6be7a10dc9b0" returned: 0 in 0.581s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:35 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Lock "cinder-quobyte-bb49e761-6d6e-447d-92b0-6be7a10dc9b0" released by "_copy_volume_from_snapshot" :: held 6.071s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:35 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Acquiring lock "cinder-quobyte-7f7663e4-a292-4aad-98e9-90bb0de349d5" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:35 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Lock "cinder-quobyte-7f7663e4-a292-4aad-98e9-90bb0de349d5" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Deleting offline snapshot 7f7663e4-a292-4aad-98e9-90bb0de349d5 of volume fb63f012-13fd-44d3-b6b2-922f62ce0a01 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:02:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] snapshot_file for this snap is: volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.7f7663e4-a292-4aad-98e9-90bb0de349d5 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:02:35 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a8afe6-4f29-408c-b105-bc6d949f9acd]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.7f7663e4-a292-4aad-98e9-90bb0de349d5 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:35 devstack sudo[88229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.7f7663e4-a292-4aad-98e9-90bb0de349d5 Apr 16 23:02:35 devstack sudo[88229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:36 devstack sudo[88229]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.7f7663e4-a292-4aad-98e9-90bb0de349d5" returned: 0 in 0.805s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:02:36 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2abc99-a917-4bac-ad4c-a3165279da12]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:36 devstack sudo[88234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01 Apr 16 23:02:36 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:36 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:02:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Flow 'volume_create_manager' (327791e0-253d-401a-a800-9679c2ce0163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:02:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f07beb-914b-41f8-90f5-bc51e09f967f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12f07beb-914b-41f8-90f5-bc51e09f967f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-602647833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d02c48b0-359b-41d3-9692-ece1f79bfa51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6671a97ad8cd423f8513db7b15d728b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:02:36Z,use_quota=True,user_id='54eb3c82cd714d3cbe3434619917fb7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d289cd39-db87-4fc7-a138-3d211e393ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d289cd39-db87-4fc7-a138-3d211e393ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f970edca-7ddd-4cf5-9be2-64d61d4e1d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f970edca-7ddd-4cf5-9be2-64d61d4e1d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd02c48b0-359b-41d3-9692-ece1f79bfa51', 'volume_name': 'volume-d02c48b0-359b-41d3-9692-ece1f79bfa51', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0917c806-645c-4071-a173-959b61ab55ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0917c806-645c-4071-a173-959b61ab55ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b175899-9f4f-49a2-8fc3-d2719beaf754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:36 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Volume d02c48b0-359b-41d3-9692-ece1f79bfa51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d02c48b0-359b-41d3-9692-ece1f79bfa51', 'volume_size': 1} Apr 16 23:02:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:36 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01" returned: 0 in 0.496s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.7f7663e4-a292-4aad-98e9-90bb0de349d5 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:36 devstack sudo[88239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.7f7663e4-a292-4aad-98e9-90bb0de349d5 Apr 16 23:02:36 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:37 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.7f7663e4-a292-4aad-98e9-90bb0de349d5" returned: 0 in 0.500s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.7f7663e4-a292-4aad-98e9-90bb0de349d5 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:37 devstack sudo[88244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.7f7663e4-a292-4aad-98e9-90bb0de349d5 Apr 16 23:02:37 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:37 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01.7f7663e4-a292-4aad-98e9-90bb0de349d5" returned: 0 in 0.438s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:37 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Lock "cinder-quobyte-7f7663e4-a292-4aad-98e9-90bb0de349d5" released by "_delete_snapshot" :: held 2.335s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.238s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.274s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:37 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-602647833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d02c48b0-359b-41d3-9692-ece1f79bfa51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6671a97ad8cd423f8513db7b15d728b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:02:36Z,use_quota=True,user_id='54eb3c82cd714d3cbe3434619917fb7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:02:37 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Creating volume d02c48b0-359b-41d3-9692-ece1f79bfa51 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:02:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:37 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:02:37 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:02:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:37 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:02:37 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:02:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:37 devstack sudo[88247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51 1073741824 Apr 16 23:02:37 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0a71a21-b2a7-4cb1-8a99-ebe2d6a5fe2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb49e761-6d6e-447d-92b0-6be7a10dc9b0', 'volume_size': 1, 'source_volid': 'fb63f012-13fd-44d3-b6b2-922f62ce0a01', 'source_volstatus': 'available'}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160c58b4-3167-4343-9aca-092c434e9b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:37 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Volume volume-bb49e761-6d6e-447d-92b0-6be7a10dc9b0 (bb49e761-6d6e-447d-92b0-6be7a10dc9b0): created successfully Apr 16 23:02:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160c58b4-3167-4343-9aca-092c434e9b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Flow 'volume_create_manager' (e7f662a8-2f6c-4adf-a327-3a84676f71c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:02:37 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-df0a0328-b730-4134-984c-27232c4fa26f tempest-VolumesGetTest-2085981255 None] Created volume successfully. Apr 16 23:02:38 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51 1073741824" returned: 0 in 0.530s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:38 devstack sudo[88252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51 Apr 16 23:02:38 devstack sudo[88252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:38 devstack sudo[88252]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51" returned: 0 in 0.474s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b175899-9f4f-49a2-8fc3-d2719beaf754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d02c48b0-359b-41d3-9692-ece1f79bfa51', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ef212d-e15b-4a48-b8f4-a6e2ddd8dd64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:38 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Volume volume-d02c48b0-359b-41d3-9692-ece1f79bfa51 (d02c48b0-359b-41d3-9692-ece1f79bfa51): created successfully Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ef212d-e15b-4a48-b8f4-a6e2ddd8dd64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Flow 'volume_create_manager' (327791e0-253d-401a-a800-9679c2ce0163) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:02:38 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-44ed6707-bbd7-4157-aa3a-817af0faceae tempest-SnapshotsActionsTest-478601352 None] Created volume successfully. Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Flow 'volume_create_manager' (510ea1fb-9505-446e-8fdd-a0d52814f7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda7dc17-7787-4e6b-8220-b3a121fce02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eda7dc17-7787-4e6b-8220-b3a121fce02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:02:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-407816384',display_name='tempest-VolumesGetTest-Volume-1615527652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c9c8240-1ed5-4f3a-b6c5-04f45012b46f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f84742468664b488f98cb337307ad52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:02:39Z,use_quota=True,user_id='9bc85d0604ed4b408d7f8174d8041db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f09492f3-ee8c-4549-809d-a73cb012fcaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f09492f3-ee8c-4549-809d-a73cb012fcaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (566f1c43-041e-45ce-a392-df2157161c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (566f1c43-041e-45ce-a392-df2157161c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c9c8240-1ed5-4f3a-b6c5-04f45012b46f', 'volume_name': 'volume-6c9c8240-1ed5-4f3a-b6c5-04f45012b46f', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13a382ab-ebd5-4fcf-ae7e-bc03e6590431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13a382ab-ebd5-4fcf-ae7e-bc03e6590431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c2bf087-9fcc-4422-83af-8f39643038e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:38 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Volume 6c9c8240-1ed5-4f3a-b6c5-04f45012b46f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c9c8240-1ed5-4f3a-b6c5-04f45012b46f', 'volume_size': 1} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:02:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-407816384',display_name='tempest-VolumesGetTest-Volume-1615527652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c9c8240-1ed5-4f3a-b6c5-04f45012b46f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f84742468664b488f98cb337307ad52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:02:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:02:39Z,use_quota=True,user_id='9bc85d0604ed4b408d7f8174d8041db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Creating volume 6c9c8240-1ed5-4f3a-b6c5-04f45012b46f {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:02:38 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:02:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6c9c8240-1ed5-4f3a-b6c5-04f45012b46f 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:38 devstack sudo[88255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6c9c8240-1ed5-4f3a-b6c5-04f45012b46f 1073741824 Apr 16 23:02:38 devstack sudo[88255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:39 devstack sudo[88255]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6c9c8240-1ed5-4f3a-b6c5-04f45012b46f 1073741824" returned: 0 in 0.483s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6c9c8240-1ed5-4f3a-b6c5-04f45012b46f {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:39 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6c9c8240-1ed5-4f3a-b6c5-04f45012b46f Apr 16 23:02:39 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e993084e-9777-49d9-82af-be4c0e6ac0fb tempest-SnapshotsActionsTest-478601352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:39 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6c9c8240-1ed5-4f3a-b6c5-04f45012b46f" returned: 0 in 0.457s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:39 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:02:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e993084e-9777-49d9-82af-be4c0e6ac0fb tempest-SnapshotsActionsTest-478601352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.231s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c2bf087-9fcc-4422-83af-8f39643038e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c9c8240-1ed5-4f3a-b6c5-04f45012b46f', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11fb2679-7c6b-465a-9413-270dc44b42e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:39 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-e993084e-9777-49d9-82af-be4c0e6ac0fb tempest-SnapshotsActionsTest-478601352 None] Creating offline snapshot d3797bcf-d0ec-4590-abb4-bdd527d667b6 of volume d02c48b0-359b-41d3-9692-ece1f79bfa51 {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:02:39 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Volume volume-6c9c8240-1ed5-4f3a-b6c5-04f45012b46f (6c9c8240-1ed5-4f3a-b6c5-04f45012b46f): created successfully Apr 16 23:02:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11fb2679-7c6b-465a-9413-270dc44b42e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Flow 'volume_create_manager' (510ea1fb-9505-446e-8fdd-a0d52814f7d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:02:39 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[77526580-63de-4ee4-88b4-a223cae306ac]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e993084e-9777-49d9-82af-be4c0e6ac0fb tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:39 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-e98097ed-b240-4e45-b8fd-84bc23d67139 tempest-VolumesGetTest-2085981255 None] Created volume successfully. Apr 16 23:02:39 devstack sudo[88263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51 Apr 16 23:02:39 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:40 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e993084e-9777-49d9-82af-be4c0e6ac0fb tempest-SnapshotsActionsTest-478601352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51" returned: 0 in 0.503s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e993084e-9777-49d9-82af-be4c0e6ac0fb tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:40 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 1G Apr 16 23:02:40 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:40 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e993084e-9777-49d9-82af-be4c0e6ac0fb tempest-SnapshotsActionsTest-478601352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 1G" returned: 0 in 0.534s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e993084e-9777-49d9-82af-be4c0e6ac0fb tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d02c48b0-359b-41d3-9692-ece1f79bfa51 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:40 devstack sudo[88273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d02c48b0-359b-41d3-9692-ece1f79bfa51 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 Apr 16 23:02:40 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:40 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a0fd384d-3164-4e60-b33e-aba8fffca97e tempest-VolumesGetTest-2085981255 None] Acquiring lock "cinder-6c9c8240-1ed5-4f3a-b6c5-04f45012b46f-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:40 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a0fd384d-3164-4e60-b33e-aba8fffca97e tempest-VolumesGetTest-2085981255 None] Lock "cinder-6c9c8240-1ed5-4f3a-b6c5-04f45012b46f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:40 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a0fd384d-3164-4e60-b33e-aba8fffca97e tempest-VolumesGetTest-2085981255 None] Acquiring lock "cinder-quobyte-6c9c8240-1ed5-4f3a-b6c5-04f45012b46f" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:40 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a0fd384d-3164-4e60-b33e-aba8fffca97e tempest-VolumesGetTest-2085981255 None] Lock "cinder-quobyte-6c9c8240-1ed5-4f3a-b6c5-04f45012b46f" acquired by "delete_volume" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:40 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d71ac9d-4b8e-4d79-80de-81f2d20e86bd]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a0fd384d-3164-4e60-b33e-aba8fffca97e tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6c9c8240-1ed5-4f3a-b6c5-04f45012b46f {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:41 devstack sudo[88275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6c9c8240-1ed5-4f3a-b6c5-04f45012b46f Apr 16 23:02:41 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:41 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e993084e-9777-49d9-82af-be4c0e6ac0fb tempest-SnapshotsActionsTest-478601352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d02c48b0-359b-41d3-9692-ece1f79bfa51 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6" returned: 0 in 0.564s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:41 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-e993084e-9777-49d9-82af-be4c0e6ac0fb tempest-SnapshotsActionsTest-478601352 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 is being set with open permissions: ugo+rw Apr 16 23:02:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e993084e-9777-49d9-82af-be4c0e6ac0fb tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:41 devstack sudo[88280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 Apr 16 23:02:41 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:41 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a0fd384d-3164-4e60-b33e-aba8fffca97e tempest-VolumesGetTest-2085981255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6c9c8240-1ed5-4f3a-b6c5-04f45012b46f" returned: 0 in 0.586s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a0fd384d-3164-4e60-b33e-aba8fffca97e tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6c9c8240-1ed5-4f3a-b6c5-04f45012b46f {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:41 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6c9c8240-1ed5-4f3a-b6c5-04f45012b46f Apr 16 23:02:41 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:41 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e993084e-9777-49d9-82af-be4c0e6ac0fb tempest-SnapshotsActionsTest-478601352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6" returned: 0 in 0.482s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e993084e-9777-49d9-82af-be4c0e6ac0fb tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:41 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.info Apr 16 23:02:41 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:42 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a0fd384d-3164-4e60-b33e-aba8fffca97e tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6c9c8240-1ed5-4f3a-b6c5-04f45012b46f" returned: 0 in 0.483s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:42 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a0fd384d-3164-4e60-b33e-aba8fffca97e tempest-VolumesGetTest-2085981255 None] Lock "cinder-quobyte-6c9c8240-1ed5-4f3a-b6c5-04f45012b46f" released by "delete_volume" :: held 1.100s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:42 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-a0fd384d-3164-4e60-b33e-aba8fffca97e tempest-VolumesGetTest-2085981255 None] Created reservations ['6ca12ac3-0a25-4daa-891e-db1f0f8a565a', '0163b77a-2db8-4079-b799-c09db0872520', '3e1ab513-1bb3-4d9f-8428-494c878e917d', '44b801d8-d524-4d89-acf6-83cf63b0173c'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:02:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a0fd384d-3164-4e60-b33e-aba8fffca97e tempest-VolumesGetTest-2085981255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a0fd384d-3164-4e60-b33e-aba8fffca97e tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:42 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a0fd384d-3164-4e60-b33e-aba8fffca97e tempest-VolumesGetTest-2085981255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:02:42 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a0fd384d-3164-4e60-b33e-aba8fffca97e tempest-VolumesGetTest-2085981255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:02:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a0fd384d-3164-4e60-b33e-aba8fffca97e tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a0fd384d-3164-4e60-b33e-aba8fffca97e tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:42 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:02:42 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:42 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e993084e-9777-49d9-82af-be4c0e6ac0fb tempest-SnapshotsActionsTest-478601352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.info" returned: 0 in 0.532s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:42 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-e993084e-9777-49d9-82af-be4c0e6ac0fb tempest-SnapshotsActionsTest-478601352 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.info is being set with open permissions: ugo+rw Apr 16 23:02:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e993084e-9777-49d9-82af-be4c0e6ac0fb tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:42 devstack sudo[88295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.info Apr 16 23:02:42 devstack sudo[88295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:42 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a0fd384d-3164-4e60-b33e-aba8fffca97e tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.487s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:42 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-a0fd384d-3164-4e60-b33e-aba8fffca97e tempest-VolumesGetTest-2085981255 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:02:42 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-a0fd384d-3164-4e60-b33e-aba8fffca97e tempest-VolumesGetTest-2085981255 None] Deleted volume successfully. Apr 16 23:02:42 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a0fd384d-3164-4e60-b33e-aba8fffca97e tempest-VolumesGetTest-2085981255 None] Lock "cinder-6c9c8240-1ed5-4f3a-b6c5-04f45012b46f-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:42 devstack sudo[88295]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e993084e-9777-49d9-82af-be4c0e6ac0fb tempest-SnapshotsActionsTest-478601352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.info" returned: 0 in 0.508s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e993084e-9777-49d9-82af-be4c0e6ac0fb tempest-SnapshotsActionsTest-478601352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.206s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:42 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-e993084e-9777-49d9-82af-be4c0e6ac0fb tempest-SnapshotsActionsTest-478601352 None] Create snapshot completed successfully Apr 16 23:02:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-373d3050-3da0-47f5-bd53-479983ba0e7f tempest-VolumesGetTest-2085981255 None] Acquiring lock "cinder-bb49e761-6d6e-447d-92b0-6be7a10dc9b0-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-373d3050-3da0-47f5-bd53-479983ba0e7f tempest-VolumesGetTest-2085981255 None] Lock "cinder-bb49e761-6d6e-447d-92b0-6be7a10dc9b0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-373d3050-3da0-47f5-bd53-479983ba0e7f tempest-VolumesGetTest-2085981255 None] Acquiring lock "cinder-quobyte-bb49e761-6d6e-447d-92b0-6be7a10dc9b0" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-373d3050-3da0-47f5-bd53-479983ba0e7f tempest-VolumesGetTest-2085981255 None] Lock "cinder-quobyte-bb49e761-6d6e-447d-92b0-6be7a10dc9b0" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:43 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[0429306d-74c0-4626-b314-0e096efa6eb9]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-373d3050-3da0-47f5-bd53-479983ba0e7f tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bb49e761-6d6e-447d-92b0-6be7a10dc9b0 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:43 devstack sudo[88299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bb49e761-6d6e-447d-92b0-6be7a10dc9b0 Apr 16 23:02:43 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:43 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-373d3050-3da0-47f5-bd53-479983ba0e7f tempest-VolumesGetTest-2085981255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bb49e761-6d6e-447d-92b0-6be7a10dc9b0" returned: 0 in 0.537s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-373d3050-3da0-47f5-bd53-479983ba0e7f tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bb49e761-6d6e-447d-92b0-6be7a10dc9b0 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:43 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bb49e761-6d6e-447d-92b0-6be7a10dc9b0 Apr 16 23:02:43 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1ee3277c-f552-47f3-9b78-3f729f644f3c tempest-SnapshotsActionsTest-478601352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1ee3277c-f552-47f3-9b78-3f729f644f3c tempest-SnapshotsActionsTest-478601352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:44 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-1ee3277c-f552-47f3-9b78-3f729f644f3c tempest-SnapshotsActionsTest-478601352 None] Creating offline snapshot 17f2f97a-0ba3-45ae-8892-9f24d43c5e79 of volume d02c48b0-359b-41d3-9692-ece1f79bfa51 {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:02:44 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b909a0-c2a7-44fb-a856-383fdf28ed09]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1ee3277c-f552-47f3-9b78-3f729f644f3c tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:44 devstack sudo[88306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 Apr 16 23:02:44 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:44 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-373d3050-3da0-47f5-bd53-479983ba0e7f tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-bb49e761-6d6e-447d-92b0-6be7a10dc9b0" returned: 0 in 0.506s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:44 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-373d3050-3da0-47f5-bd53-479983ba0e7f tempest-VolumesGetTest-2085981255 None] Lock "cinder-quobyte-bb49e761-6d6e-447d-92b0-6be7a10dc9b0" released by "delete_volume" :: held 1.072s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:44 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-373d3050-3da0-47f5-bd53-479983ba0e7f tempest-VolumesGetTest-2085981255 None] Created reservations ['f2592606-7100-4078-9171-1e44fdced188', '8f36713f-4b25-4834-9998-c87b5482eeec', '38d59e07-cc48-4e2c-856c-dae18b5d8a73', '6c5de4f8-d4c1-42d9-9a23-391aa82f2e74'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:02:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-373d3050-3da0-47f5-bd53-479983ba0e7f tempest-VolumesGetTest-2085981255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-373d3050-3da0-47f5-bd53-479983ba0e7f tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:44 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-373d3050-3da0-47f5-bd53-479983ba0e7f tempest-VolumesGetTest-2085981255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:02:44 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-373d3050-3da0-47f5-bd53-479983ba0e7f tempest-VolumesGetTest-2085981255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:02:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-373d3050-3da0-47f5-bd53-479983ba0e7f tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-373d3050-3da0-47f5-bd53-479983ba0e7f tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:44 devstack sudo[88309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:02:44 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:44 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1ee3277c-f552-47f3-9b78-3f729f644f3c tempest-SnapshotsActionsTest-478601352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6" returned: 0 in 0.572s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:44 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-1ee3277c-f552-47f3-9b78-3f729f644f3c tempest-SnapshotsActionsTest-478601352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d02c48b0-359b-41d3-9692-ece1f79bfa51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:02:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1ee3277c-f552-47f3-9b78-3f729f644f3c tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.17f2f97a-0ba3-45ae-8892-9f24d43c5e79 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:44 devstack sudo[88314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.17f2f97a-0ba3-45ae-8892-9f24d43c5e79 1G Apr 16 23:02:44 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:44 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-373d3050-3da0-47f5-bd53-479983ba0e7f tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.469s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:44 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-373d3050-3da0-47f5-bd53-479983ba0e7f tempest-VolumesGetTest-2085981255 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:02:44 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-373d3050-3da0-47f5-bd53-479983ba0e7f tempest-VolumesGetTest-2085981255 None] Deleted volume successfully. Apr 16 23:02:44 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-373d3050-3da0-47f5-bd53-479983ba0e7f tempest-VolumesGetTest-2085981255 None] Lock "cinder-bb49e761-6d6e-447d-92b0-6be7a10dc9b0-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:45 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1ee3277c-f552-47f3-9b78-3f729f644f3c tempest-SnapshotsActionsTest-478601352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.17f2f97a-0ba3-45ae-8892-9f24d43c5e79 1G" returned: 0 in 0.576s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1ee3277c-f552-47f3-9b78-3f729f644f3c tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.17f2f97a-0ba3-45ae-8892-9f24d43c5e79 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:45 devstack sudo[88320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.17f2f97a-0ba3-45ae-8892-9f24d43c5e79 Apr 16 23:02:45 devstack sudo[88320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-99dcea24-564b-40e7-8ec5-f2d14f6d71dc tempest-VolumesGetTest-2085981255 None] Acquiring lock "cinder-fb63f012-13fd-44d3-b6b2-922f62ce0a01-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-99dcea24-564b-40e7-8ec5-f2d14f6d71dc tempest-VolumesGetTest-2085981255 None] Lock "cinder-fb63f012-13fd-44d3-b6b2-922f62ce0a01-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-99dcea24-564b-40e7-8ec5-f2d14f6d71dc tempest-VolumesGetTest-2085981255 None] Acquiring lock "cinder-quobyte-fb63f012-13fd-44d3-b6b2-922f62ce0a01" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-99dcea24-564b-40e7-8ec5-f2d14f6d71dc tempest-VolumesGetTest-2085981255 None] Lock "cinder-quobyte-fb63f012-13fd-44d3-b6b2-922f62ce0a01" acquired by "delete_volume" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:45 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35bf39c-b151-4931-88b5-9d3b311caabf]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-99dcea24-564b-40e7-8ec5-f2d14f6d71dc tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:45 devstack sudo[88322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01 Apr 16 23:02:45 devstack sudo[88322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:45 devstack sudo[88320]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1ee3277c-f552-47f3-9b78-3f729f644f3c tempest-SnapshotsActionsTest-478601352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.17f2f97a-0ba3-45ae-8892-9f24d43c5e79" returned: 0 in 0.581s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:45 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-1ee3277c-f552-47f3-9b78-3f729f644f3c tempest-SnapshotsActionsTest-478601352 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.17f2f97a-0ba3-45ae-8892-9f24d43c5e79 is being set with open permissions: ugo+rw Apr 16 23:02:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1ee3277c-f552-47f3-9b78-3f729f644f3c tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.17f2f97a-0ba3-45ae-8892-9f24d43c5e79 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:45 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.17f2f97a-0ba3-45ae-8892-9f24d43c5e79 Apr 16 23:02:45 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:46 devstack sudo[88322]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-99dcea24-564b-40e7-8ec5-f2d14f6d71dc tempest-VolumesGetTest-2085981255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01" returned: 0 in 0.511s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-99dcea24-564b-40e7-8ec5-f2d14f6d71dc tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:46 devstack sudo[88332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01 Apr 16 23:02:46 devstack sudo[88332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:46 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1ee3277c-f552-47f3-9b78-3f729f644f3c tempest-SnapshotsActionsTest-478601352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.17f2f97a-0ba3-45ae-8892-9f24d43c5e79" returned: 0 in 0.565s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1ee3277c-f552-47f3-9b78-3f729f644f3c tempest-SnapshotsActionsTest-478601352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.360s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:46 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-1ee3277c-f552-47f3-9b78-3f729f644f3c tempest-SnapshotsActionsTest-478601352 None] Create snapshot completed successfully Apr 16 23:02:46 devstack sudo[88332]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-99dcea24-564b-40e7-8ec5-f2d14f6d71dc tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-fb63f012-13fd-44d3-b6b2-922f62ce0a01" returned: 0 in 0.452s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-99dcea24-564b-40e7-8ec5-f2d14f6d71dc tempest-VolumesGetTest-2085981255 None] Lock "cinder-quobyte-fb63f012-13fd-44d3-b6b2-922f62ce0a01" released by "delete_volume" :: held 1.016s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:46 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-99dcea24-564b-40e7-8ec5-f2d14f6d71dc tempest-VolumesGetTest-2085981255 None] Created reservations ['e4a9166c-fdf3-4328-bfd4-06fc242734b6', '93747f25-9d92-4a78-ae8b-73e091514494', 'a35f21cc-9d5f-4806-8cdc-b36be77e1ae8', '8e2a468a-2654-4190-b8d9-48ea780e63ce'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:02:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-99dcea24-564b-40e7-8ec5-f2d14f6d71dc tempest-VolumesGetTest-2085981255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-99dcea24-564b-40e7-8ec5-f2d14f6d71dc tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:46 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-99dcea24-564b-40e7-8ec5-f2d14f6d71dc tempest-VolumesGetTest-2085981255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:02:46 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-99dcea24-564b-40e7-8ec5-f2d14f6d71dc tempest-VolumesGetTest-2085981255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:02:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-99dcea24-564b-40e7-8ec5-f2d14f6d71dc tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-99dcea24-564b-40e7-8ec5-f2d14f6d71dc tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:46 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:02:46 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:47 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-99dcea24-564b-40e7-8ec5-f2d14f6d71dc tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.487s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:47 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-99dcea24-564b-40e7-8ec5-f2d14f6d71dc tempest-VolumesGetTest-2085981255 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:02:47 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-99dcea24-564b-40e7-8ec5-f2d14f6d71dc tempest-VolumesGetTest-2085981255 None] Deleted volume successfully. Apr 16 23:02:47 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-99dcea24-564b-40e7-8ec5-f2d14f6d71dc tempest-VolumesGetTest-2085981255 None] Lock "cinder-fb63f012-13fd-44d3-b6b2-922f62ce0a01-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:47 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5aa0500b-b986-4515-a27d-377fd568e81f tempest-SnapshotsActionsTest-211388823 None] Acquiring lock "cinder-17f2f97a-0ba3-45ae-8892-9f24d43c5e79-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:47 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5aa0500b-b986-4515-a27d-377fd568e81f tempest-SnapshotsActionsTest-211388823 None] Lock "cinder-17f2f97a-0ba3-45ae-8892-9f24d43c5e79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:47 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5aa0500b-b986-4515-a27d-377fd568e81f tempest-SnapshotsActionsTest-211388823 None] Acquiring lock "cinder-quobyte-d02c48b0-359b-41d3-9692-ece1f79bfa51" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:47 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5aa0500b-b986-4515-a27d-377fd568e81f tempest-SnapshotsActionsTest-211388823 None] Lock "cinder-quobyte-d02c48b0-359b-41d3-9692-ece1f79bfa51" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:47 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5aa0500b-b986-4515-a27d-377fd568e81f tempest-SnapshotsActionsTest-211388823 None] Acquiring lock "cinder-quobyte-17f2f97a-0ba3-45ae-8892-9f24d43c5e79" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:47 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5aa0500b-b986-4515-a27d-377fd568e81f tempest-SnapshotsActionsTest-211388823 None] Lock "cinder-quobyte-17f2f97a-0ba3-45ae-8892-9f24d43c5e79" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:47 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-5aa0500b-b986-4515-a27d-377fd568e81f tempest-SnapshotsActionsTest-211388823 None] Deleting offline snapshot 17f2f97a-0ba3-45ae-8892-9f24d43c5e79 of volume d02c48b0-359b-41d3-9692-ece1f79bfa51 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:02:47 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-5aa0500b-b986-4515-a27d-377fd568e81f tempest-SnapshotsActionsTest-211388823 None] snapshot_file for this snap is: volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.17f2f97a-0ba3-45ae-8892-9f24d43c5e79 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:02:47 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[6012c476-c841-4e38-8134-3ea088f132b3]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5aa0500b-b986-4515-a27d-377fd568e81f tempest-SnapshotsActionsTest-211388823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.17f2f97a-0ba3-45ae-8892-9f24d43c5e79 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:47 devstack sudo[88345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.17f2f97a-0ba3-45ae-8892-9f24d43c5e79 Apr 16 23:02:47 devstack sudo[88345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:48 devstack sudo[88345]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5aa0500b-b986-4515-a27d-377fd568e81f tempest-SnapshotsActionsTest-211388823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.17f2f97a-0ba3-45ae-8892-9f24d43c5e79" returned: 0 in 0.589s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:48 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-5aa0500b-b986-4515-a27d-377fd568e81f tempest-SnapshotsActionsTest-211388823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d02c48b0-359b-41d3-9692-ece1f79bfa51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:02:48 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[59595b87-4ca9-4136-a5f3-2f3a8ba63d89]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5aa0500b-b986-4515-a27d-377fd568e81f tempest-SnapshotsActionsTest-211388823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:48 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:02:48 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Flow 'volume_create_manager' (1e703708-a4a5-473d-8922-32691c32e669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:02:48 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f36dbf0-896e-4480-9a66-f5a8e12bd21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:48 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f36dbf0-896e-4480-9a66-f5a8e12bd21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-643608866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76b961e-05b2-44fa-81ea-51417c268381,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9f84742468664b488f98cb337307ad52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:02:48Z,use_quota=True,user_id='9bc85d0604ed4b408d7f8174d8041db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:48 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927ff4df-43d9-4f92-915d-026e18450777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:48 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (927ff4df-43d9-4f92-915d-026e18450777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:48 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234a7cfa-be18-4644-bcf5-b24b7310dcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:48 devstack cinder-volume[81971]: DEBUG cinder.image.glance [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Creating Keystone auth plugin from conf {{(pid=81971) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 16 23:02:48 devstack sudo[88350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 Apr 16 23:02:48 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:48 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234a7cfa-be18-4644-bcf5-b24b7310dcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c76b961e-05b2-44fa-81ea-51417c268381', 'volume_name': 'volume-c76b961e-05b2-44fa-81ea-51417c268381', 'volume_size': 1, 'image_id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '70c7e2479fd847c6b5fabb2201f59bd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'created_at': datetime.datetime(2026, 4, 16, 20, 51, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 20, 51, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:48 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81262b5-a054-4718-8deb-c41ecf82ac82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:48 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b81262b5-a054-4718-8deb-c41ecf82ac82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:48 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5436419a-eff3-4a7a-849f-3bf7900fd273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:48 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Volume c76b961e-05b2-44fa-81ea-51417c268381: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c76b961e-05b2-44fa-81ea-51417c268381', 'volume_size': 1, 'image_id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '70c7e2479fd847c6b5fabb2201f59bd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'created_at': datetime.datetime(2026, 4, 16, 20, 51, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 20, 51, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 16 23:02:48 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Trying to clone c76b961e-05b2-44fa-81ea-51417c268381 from image f3c20cd6-f75b-4471-a89e-2a8c84f8b824 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'metadata': {}}]). {{(pid=81971) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 16 23:02:48 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_vmr0alh5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81971) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 16 23:02:48 devstack cinder-volume[81971]: INFO cinder.image.image_utils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Image download 20.69 MB at 20.69 MB/s Apr 16 23:02:48 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50bdbf4-1644-4029-b338-f369d1df6e98]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_vmr0alh5devstack@QuobyteHD {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:48 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_vmr0alh5devstack@QuobyteHD Apr 16 23:02:48 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:48 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5aa0500b-b986-4515-a27d-377fd568e81f tempest-SnapshotsActionsTest-211388823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6" returned: 0 in 0.677s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:48 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-5aa0500b-b986-4515-a27d-377fd568e81f tempest-SnapshotsActionsTest-211388823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d02c48b0-359b-41d3-9692-ece1f79bfa51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:02:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5aa0500b-b986-4515-a27d-377fd568e81f tempest-SnapshotsActionsTest-211388823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.17f2f97a-0ba3-45ae-8892-9f24d43c5e79 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:48 devstack sudo[88358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.17f2f97a-0ba3-45ae-8892-9f24d43c5e79 Apr 16 23:02:48 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:49 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_vmr0alh5devstack@QuobyteHD" returned: 0 in 0.529s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:49 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Temporary image f3c20cd6-f75b-4471-a89e-2a8c84f8b824 is fetched for user 9bc85d0604ed4b408d7f8174d8041db4. {{(pid=81971) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 16 23:02:49 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb009390-960f-46ea-b5bc-19e6311ce391]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_vmr0alh5devstack@QuobyteHD {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:49 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_vmr0alh5devstack@QuobyteHD Apr 16 23:02:49 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:49 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5aa0500b-b986-4515-a27d-377fd568e81f tempest-SnapshotsActionsTest-211388823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.17f2f97a-0ba3-45ae-8892-9f24d43c5e79" returned: 0 in 0.560s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5aa0500b-b986-4515-a27d-377fd568e81f tempest-SnapshotsActionsTest-211388823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.17f2f97a-0ba3-45ae-8892-9f24d43c5e79 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:49 devstack sudo[88368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.17f2f97a-0ba3-45ae-8892-9f24d43c5e79 Apr 16 23:02:49 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:49 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_vmr0alh5devstack@QuobyteHD" returned: 0 in 0.576s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:49 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-643608866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76b961e-05b2-44fa-81ea-51417c268381,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9f84742468664b488f98cb337307ad52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:02:48Z,use_quota=True,user_id='9bc85d0604ed4b408d7f8174d8041db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:02:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Creating volume c76b961e-05b2-44fa-81ea-51417c268381 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:02:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:02:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:02:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:02:49 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:02:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5aa0500b-b986-4515-a27d-377fd568e81f tempest-SnapshotsActionsTest-211388823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.17f2f97a-0ba3-45ae-8892-9f24d43c5e79" returned: 0 in 0.472s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:49 devstack sudo[88374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381 1073741824 Apr 16 23:02:49 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:49 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5aa0500b-b986-4515-a27d-377fd568e81f tempest-SnapshotsActionsTest-211388823 None] Lock "cinder-quobyte-17f2f97a-0ba3-45ae-8892-9f24d43c5e79" released by "_delete_snapshot" :: held 2.373s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:49 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5aa0500b-b986-4515-a27d-377fd568e81f tempest-SnapshotsActionsTest-211388823 None] Lock "cinder-quobyte-d02c48b0-359b-41d3-9692-ece1f79bfa51" released by "delete_snapshot" :: held 2.386s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:49 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-5aa0500b-b986-4515-a27d-377fd568e81f tempest-SnapshotsActionsTest-211388823 None] Created reservations ['6b8f9492-296b-4d42-852f-eb17bd727909', 'd3cba582-f87c-4681-86c8-352b77076d08', '1444cefd-c71b-471d-8ff2-c9baffe0ef8f', '4eeb641b-1514-4fa9-af79-b8ffe6e42f59'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:02:49 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-5aa0500b-b986-4515-a27d-377fd568e81f tempest-SnapshotsActionsTest-211388823 None] Delete snapshot completed successfully. Apr 16 23:02:49 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5aa0500b-b986-4515-a27d-377fd568e81f tempest-SnapshotsActionsTest-211388823 None] Lock "cinder-17f2f97a-0ba3-45ae-8892-9f24d43c5e79-delete_snapshot" released by "delete_snapshot" :: held 2.482s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:50 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381 1073741824" returned: 0 in 0.556s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:50 devstack sudo[88379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381 Apr 16 23:02:50 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-31f5042e-33f5-4680-9481-01c93fd7e9bc tempest-SnapshotsActionsTest-478601352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:50 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381" returned: 0 in 0.497s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:50 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:02:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-31f5042e-33f5-4680-9481-01c93fd7e9bc tempest-SnapshotsActionsTest-478601352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.065s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:50 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-31f5042e-33f5-4680-9481-01c93fd7e9bc tempest-SnapshotsActionsTest-478601352 None] Creating offline snapshot 62c41b6c-7273-47d0-be03-a2d2e6e42304 of volume d02c48b0-359b-41d3-9692-ece1f79bfa51 {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:02:50 devstack cinder-volume[81971]: DEBUG cinder.volume.volume_utils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Attempting download of f3c20cd6-f75b-4471-a89e-2a8c84f8b824 ((None, [{'url': 'file:///opt/stack/data/glance/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'metadata': {}}])) to volume c76b961e-05b2-44fa-81ea-51417c268381. {{(pid=81971) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 16 23:02:50 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ec66dc-e29b-4f79-b04c-c842014f658f]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-31f5042e-33f5-4680-9481-01c93fd7e9bc tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:50 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87197f3-66ad-4c7e-8579-aa2853a1c050]: (4, 'raw') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_6um7ykkp {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:50 devstack sudo[88382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 Apr 16 23:02:50 devstack sudo[88382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:51 devstack sudo[88383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_6um7ykkp Apr 16 23:02:51 devstack sudo[88383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:51 devstack sudo[88382]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-31f5042e-33f5-4680-9481-01c93fd7e9bc tempest-SnapshotsActionsTest-478601352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6" returned: 0 in 0.553s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:51 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-31f5042e-33f5-4680-9481-01c93fd7e9bc tempest-SnapshotsActionsTest-478601352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d02c48b0-359b-41d3-9692-ece1f79bfa51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:02:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-31f5042e-33f5-4680-9481-01c93fd7e9bc tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.62c41b6c-7273-47d0-be03-a2d2e6e42304 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:51 devstack sudo[88383]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_6um7ykkp" returned: 0 in 0.528s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_6um7ykkp {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:51 devstack sudo[88391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.62c41b6c-7273-47d0-be03-a2d2e6e42304 1G Apr 16 23:02:51 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:51 devstack sudo[88392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_6um7ykkp Apr 16 23:02:51 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:52 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_6um7ykkp" returned: 1 in 0.551s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_6um7ykkp' failed. Not Retrying. {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 23:02:52 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac363e6-3cac-4cc4-9744-f2111a49872e]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_vmr0alh5devstack@QuobyteHD {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:52 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-31f5042e-33f5-4680-9481-01c93fd7e9bc tempest-SnapshotsActionsTest-478601352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.62c41b6c-7273-47d0-be03-a2d2e6e42304 1G" returned: 0 in 0.603s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-31f5042e-33f5-4680-9481-01c93fd7e9bc tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.62c41b6c-7273-47d0-be03-a2d2e6e42304 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:52 devstack sudo[88403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.62c41b6c-7273-47d0-be03-a2d2e6e42304 Apr 16 23:02:52 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:52 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_vmr0alh5devstack@QuobyteHD Apr 16 23:02:52 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:52 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_vmr0alh5devstack@QuobyteHD" returned: 0 in 0.507s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:52 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] f3c20cd6-f75b-4471-a89e-2a8c84f8b824 was qcow2, converting to raw {{(pid=81971) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 16 23:02:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_vmr0alh5devstack@QuobyteHD /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:52 devstack sudo[88413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_vmr0alh5devstack@QuobyteHD /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381 Apr 16 23:02:52 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:52 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-31f5042e-33f5-4680-9481-01c93fd7e9bc tempest-SnapshotsActionsTest-478601352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.62c41b6c-7273-47d0-be03-a2d2e6e42304" returned: 0 in 0.511s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:52 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-31f5042e-33f5-4680-9481-01c93fd7e9bc tempest-SnapshotsActionsTest-478601352 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.62c41b6c-7273-47d0-be03-a2d2e6e42304 is being set with open permissions: ugo+rw Apr 16 23:02:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-31f5042e-33f5-4680-9481-01c93fd7e9bc tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.62c41b6c-7273-47d0-be03-a2d2e6e42304 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:52 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.62c41b6c-7273-47d0-be03-a2d2e6e42304 Apr 16 23:02:52 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:53 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-31f5042e-33f5-4680-9481-01c93fd7e9bc tempest-SnapshotsActionsTest-478601352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.62c41b6c-7273-47d0-be03-a2d2e6e42304" returned: 0 in 0.469s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-31f5042e-33f5-4680-9481-01c93fd7e9bc tempest-SnapshotsActionsTest-478601352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.202s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:53 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-31f5042e-33f5-4680-9481-01c93fd7e9bc tempest-SnapshotsActionsTest-478601352 None] Create snapshot completed successfully Apr 16 23:02:53 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_vmr0alh5devstack@QuobyteHD /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381" returned: 0 in 0.980s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:53 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f3c20cd6-f75b-4471-a89e-2a8c84f8b824_vmr0alh5devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381 {{(pid=81971) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 23:02:53 devstack cinder-volume[81971]: INFO cinder.image.image_utils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Converted 112.00 MB image at 112.00 MB/s Apr 16 23:02:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:53 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381 1G Apr 16 23:02:53 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:54 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381 1G" returned: 0 in 0.489s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:54 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c03fc01f-9524-446e-85e5-d9b649d4b414 tempest-SnapshotsActionsTest-211388823 None] Acquiring lock "cinder-62c41b6c-7273-47d0-be03-a2d2e6e42304-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:54 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43253b0-8308-47ba-a4dd-d9d1b47bfa90]: (4, 'raw') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:54 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c03fc01f-9524-446e-85e5-d9b649d4b414 tempest-SnapshotsActionsTest-211388823 None] Lock "cinder-62c41b6c-7273-47d0-be03-a2d2e6e42304-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:54 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c03fc01f-9524-446e-85e5-d9b649d4b414 tempest-SnapshotsActionsTest-211388823 None] Acquiring lock "cinder-quobyte-d02c48b0-359b-41d3-9692-ece1f79bfa51" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:54 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c03fc01f-9524-446e-85e5-d9b649d4b414 tempest-SnapshotsActionsTest-211388823 None] Lock "cinder-quobyte-d02c48b0-359b-41d3-9692-ece1f79bfa51" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:54 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c03fc01f-9524-446e-85e5-d9b649d4b414 tempest-SnapshotsActionsTest-211388823 None] Acquiring lock "cinder-quobyte-62c41b6c-7273-47d0-be03-a2d2e6e42304" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:54 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c03fc01f-9524-446e-85e5-d9b649d4b414 tempest-SnapshotsActionsTest-211388823 None] Lock "cinder-quobyte-62c41b6c-7273-47d0-be03-a2d2e6e42304" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:54 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-c03fc01f-9524-446e-85e5-d9b649d4b414 tempest-SnapshotsActionsTest-211388823 None] Deleting offline snapshot 62c41b6c-7273-47d0-be03-a2d2e6e42304 of volume d02c48b0-359b-41d3-9692-ece1f79bfa51 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:02:54 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-c03fc01f-9524-446e-85e5-d9b649d4b414 tempest-SnapshotsActionsTest-211388823 None] snapshot_file for this snap is: volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.62c41b6c-7273-47d0-be03-a2d2e6e42304 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:02:54 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a76f1e8-4e6a-43ca-b982-8b6fb9acd69d]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c03fc01f-9524-446e-85e5-d9b649d4b414 tempest-SnapshotsActionsTest-211388823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.62c41b6c-7273-47d0-be03-a2d2e6e42304 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:54 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381 Apr 16 23:02:54 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:54 devstack sudo[88435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.62c41b6c-7273-47d0-be03-a2d2e6e42304 Apr 16 23:02:54 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:54 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381" returned: 0 in 0.552s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:54 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:54 devstack sudo[88443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381 Apr 16 23:02:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c03fc01f-9524-446e-85e5-d9b649d4b414 tempest-SnapshotsActionsTest-211388823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.62c41b6c-7273-47d0-be03-a2d2e6e42304" returned: 0 in 0.556s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:54 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:54 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-c03fc01f-9524-446e-85e5-d9b649d4b414 tempest-SnapshotsActionsTest-211388823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d02c48b0-359b-41d3-9692-ece1f79bfa51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:02:54 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[569a0555-7bfa-4cd4-bf4c-1c36a5ceffc3]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c03fc01f-9524-446e-85e5-d9b649d4b414 tempest-SnapshotsActionsTest-211388823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:54 devstack sudo[88445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 Apr 16 23:02:54 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:55 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381" returned: 1 in 0.531s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381' failed. Not Retrying. {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 23:02:55 devstack cinder-volume[81971]: DEBUG cinder.volume.volume_utils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Downloaded image f3c20cd6-f75b-4471-a89e-2a8c84f8b824 ((None, [{'url': 'file:///opt/stack/data/glance/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'metadata': {}}])) to volume c76b961e-05b2-44fa-81ea-51417c268381 successfully. {{(pid=81971) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 16 23:02:55 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Temporary image f3c20cd6-f75b-4471-a89e-2a8c84f8b824 for user 9bc85d0604ed4b408d7f8174d8041db4 is deleted. {{(pid=81971) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 16 23:02:55 devstack cinder-volume[81971]: DEBUG cinder.volume.volume_utils [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Marking volume c76b961e-05b2-44fa-81ea-51417c268381 as bootable. {{(pid=81971) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 16 23:02:55 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Copying metadata from image f3c20cd6-f75b-4471-a89e-2a8c84f8b824 to c76b961e-05b2-44fa-81ea-51417c268381. {{(pid=81971) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 16 23:02:55 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Creating volume glance metadata for volume c76b961e-05b2-44fa-81ea-51417c268381 backed by image f3c20cd6-f75b-4471-a89e-2a8c84f8b824 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81971) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 16 23:02:55 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c03fc01f-9524-446e-85e5-d9b649d4b414 tempest-SnapshotsActionsTest-211388823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6" returned: 0 in 0.518s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:55 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-c03fc01f-9524-446e-85e5-d9b649d4b414 tempest-SnapshotsActionsTest-211388823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d02c48b0-359b-41d3-9692-ece1f79bfa51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:02:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c03fc01f-9524-446e-85e5-d9b649d4b414 tempest-SnapshotsActionsTest-211388823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.62c41b6c-7273-47d0-be03-a2d2e6e42304 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:55 devstack sudo[88453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.62c41b6c-7273-47d0-be03-a2d2e6e42304 Apr 16 23:02:55 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5436419a-eff3-4a7a-849f-3bf7900fd273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c76b961e-05b2-44fa-81ea-51417c268381', 'volume_size': 1, 'image_id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '70c7e2479fd847c6b5fabb2201f59bd9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f3c20cd6-f75b-4471-a89e-2a8c84f8b824', 'created_at': datetime.datetime(2026, 4, 16, 20, 51, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 16, 20, 51, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f3c20cd6-f75b-4471-a89e-2a8c84f8b824/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d5711d-4a4a-4069-a19a-be442fc5eb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:55 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Volume volume-c76b961e-05b2-44fa-81ea-51417c268381 (c76b961e-05b2-44fa-81ea-51417c268381): created successfully Apr 16 23:02:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d5711d-4a4a-4069-a19a-be442fc5eb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Flow 'volume_create_manager' (1e703708-a4a5-473d-8922-32691c32e669) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:02:55 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-05ff66e4-7f07-4f11-b9e4-2bd39d24d8dc tempest-VolumesGetTest-2085981255 None] Created volume successfully. Apr 16 23:02:55 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c03fc01f-9524-446e-85e5-d9b649d4b414 tempest-SnapshotsActionsTest-211388823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.62c41b6c-7273-47d0-be03-a2d2e6e42304" returned: 0 in 0.591s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c03fc01f-9524-446e-85e5-d9b649d4b414 tempest-SnapshotsActionsTest-211388823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.62c41b6c-7273-47d0-be03-a2d2e6e42304 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:55 devstack sudo[88458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.62c41b6c-7273-47d0-be03-a2d2e6e42304 Apr 16 23:02:55 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Flow 'volume_create_manager' (a5664c46-a1b2-4974-9a3a-5c6b4cd75ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11fd30e-512c-499d-ba70-7f35b342662a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b11fd30e-512c-499d-ba70-7f35b342662a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:02:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1808905622',display_name='tempest-VolumesGetTest-Volume-1531285339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f84742468664b488f98cb337307ad52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:02:56Z,use_quota=True,user_id='9bc85d0604ed4b408d7f8174d8041db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579bc120-1890-4625-b99a-3172ae65f199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (579bc120-1890-4625-b99a-3172ae65f199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497aa445-66c5-4fa6-846f-d9ce19636afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497aa445-66c5-4fa6-846f-d9ce19636afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e', 'volume_name': 'volume-6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a466f4b9-0295-4b3e-9eef-71bd5a82a1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a466f4b9-0295-4b3e-9eef-71bd5a82a1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3169e5ac-e089-44bc-b23b-6d6b2cdc0e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:56 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Volume 6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e', 'volume_size': 1} Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:02:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1808905622',display_name='tempest-VolumesGetTest-Volume-1531285339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f84742468664b488f98cb337307ad52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:02:56Z,use_quota=True,user_id='9bc85d0604ed4b408d7f8174d8041db4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Creating volume 6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:02:56 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:56 devstack sudo[88460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e 1073741824 Apr 16 23:02:56 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:56 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c03fc01f-9524-446e-85e5-d9b649d4b414 tempest-SnapshotsActionsTest-211388823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.62c41b6c-7273-47d0-be03-a2d2e6e42304" returned: 0 in 0.505s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c03fc01f-9524-446e-85e5-d9b649d4b414 tempest-SnapshotsActionsTest-211388823 None] Lock "cinder-quobyte-62c41b6c-7273-47d0-be03-a2d2e6e42304" released by "_delete_snapshot" :: held 2.243s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c03fc01f-9524-446e-85e5-d9b649d4b414 tempest-SnapshotsActionsTest-211388823 None] Lock "cinder-quobyte-d02c48b0-359b-41d3-9692-ece1f79bfa51" released by "delete_snapshot" :: held 2.257s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-c03fc01f-9524-446e-85e5-d9b649d4b414 tempest-SnapshotsActionsTest-211388823 None] Created reservations ['d0b90854-9be1-4b31-83c5-4603c71bb8ad', '58f722ef-b662-4450-8f57-c7777d8dc381', '1ea0e3be-6b81-4952-bb88-37c61f85033c', '2a0f905c-379c-464b-82f7-d5f6c73ef499'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:02:56 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-c03fc01f-9524-446e-85e5-d9b649d4b414 tempest-SnapshotsActionsTest-211388823 None] Delete snapshot completed successfully. Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c03fc01f-9524-446e-85e5-d9b649d4b414 tempest-SnapshotsActionsTest-211388823 None] Lock "cinder-62c41b6c-7273-47d0-be03-a2d2e6e42304-delete_snapshot" released by "delete_snapshot" :: held 2.359s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:56 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e 1073741824" returned: 0 in 0.547s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:56 devstack sudo[88466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e Apr 16 23:02:56 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:57 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e" returned: 0 in 0.452s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:02:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3169e5ac-e089-44bc-b23b-6d6b2cdc0e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200759db-f2f6-43e5-a6be-9eeaa11375af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:02:57 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Volume volume-6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e (6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e): created successfully Apr 16 23:02:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (200759db-f2f6-43e5-a6be-9eeaa11375af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:02:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Flow 'volume_create_manager' (a5664c46-a1b2-4974-9a3a-5c6b4cd75ffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:02:57 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-5e8d4b01-f527-4252-9c23-70c9b46441fc tempest-VolumesGetTest-2085981255 None] Created volume successfully. Apr 16 23:02:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ff7fadbd-92f9-4f1b-90ce-71d01461ec91 tempest-SnapshotsActionsTest-478601352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ff7fadbd-92f9-4f1b-90ce-71d01461ec91 tempest-SnapshotsActionsTest-478601352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-ff7fadbd-92f9-4f1b-90ce-71d01461ec91 tempest-SnapshotsActionsTest-478601352 None] Creating offline snapshot d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334 of volume d02c48b0-359b-41d3-9692-ece1f79bfa51 {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:02:57 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8627a5-80ef-4929-8f26-2c118aec794a]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ff7fadbd-92f9-4f1b-90ce-71d01461ec91 tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:57 devstack sudo[88469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 Apr 16 23:02:57 devstack sudo[88469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:57 devstack sudo[88469]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ff7fadbd-92f9-4f1b-90ce-71d01461ec91 tempest-SnapshotsActionsTest-478601352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6" returned: 0 in 0.494s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-ff7fadbd-92f9-4f1b-90ce-71d01461ec91 tempest-SnapshotsActionsTest-478601352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d02c48b0-359b-41d3-9692-ece1f79bfa51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:02:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ff7fadbd-92f9-4f1b-90ce-71d01461ec91 tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:57 devstack sudo[88474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334 1G Apr 16 23:02:57 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:58 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-cf3a83ab-d98b-41fd-80ab-bdd935753b6f tempest-VolumesGetTest-2085981255 None] Acquiring lock "cinder-6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:58 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-cf3a83ab-d98b-41fd-80ab-bdd935753b6f tempest-VolumesGetTest-2085981255 None] Lock "cinder-6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:58 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-cf3a83ab-d98b-41fd-80ab-bdd935753b6f tempest-VolumesGetTest-2085981255 None] Acquiring lock "cinder-quobyte-6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:02:58 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-cf3a83ab-d98b-41fd-80ab-bdd935753b6f tempest-VolumesGetTest-2085981255 None] Lock "cinder-quobyte-6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:02:58 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee38fa27-3c73-4649-be5a-edb105e5b9d0]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:02:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cf3a83ab-d98b-41fd-80ab-bdd935753b6f tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:58 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e Apr 16 23:02:58 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:58 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ff7fadbd-92f9-4f1b-90ce-71d01461ec91 tempest-SnapshotsActionsTest-478601352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334 1G" returned: 0 in 0.660s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ff7fadbd-92f9-4f1b-90ce-71d01461ec91 tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:58 devstack sudo[88481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334 Apr 16 23:02:58 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:58 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cf3a83ab-d98b-41fd-80ab-bdd935753b6f tempest-VolumesGetTest-2085981255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e" returned: 0 in 0.564s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cf3a83ab-d98b-41fd-80ab-bdd935753b6f tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:58 devstack sudo[88486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e Apr 16 23:02:58 devstack sudo[88486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:59 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ff7fadbd-92f9-4f1b-90ce-71d01461ec91 tempest-SnapshotsActionsTest-478601352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334" returned: 0 in 0.473s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:59 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-ff7fadbd-92f9-4f1b-90ce-71d01461ec91 tempest-SnapshotsActionsTest-478601352 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334 is being set with open permissions: ugo+rw Apr 16 23:02:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ff7fadbd-92f9-4f1b-90ce-71d01461ec91 tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:59 devstack sudo[88523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334 Apr 16 23:02:59 devstack sudo[88523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:59 devstack sudo[88486]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cf3a83ab-d98b-41fd-80ab-bdd935753b6f tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e" returned: 0 in 0.472s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:59 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-cf3a83ab-d98b-41fd-80ab-bdd935753b6f tempest-VolumesGetTest-2085981255 None] Lock "cinder-quobyte-6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e" released by "delete_volume" :: held 1.066s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:02:59 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-cf3a83ab-d98b-41fd-80ab-bdd935753b6f tempest-VolumesGetTest-2085981255 None] Created reservations ['24b1afeb-870d-4ff2-be4e-1cddaf7836af', '593dc0fc-c133-4141-8081-9f50f6566c2e', '49b03e9a-6c88-4cea-a2d3-b379dd0d8764', 'f58c05dc-0027-4303-bf44-d85840a31a68'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:02:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-cf3a83ab-d98b-41fd-80ab-bdd935753b6f tempest-VolumesGetTest-2085981255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:02:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-cf3a83ab-d98b-41fd-80ab-bdd935753b6f tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:02:59 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-cf3a83ab-d98b-41fd-80ab-bdd935753b6f tempest-VolumesGetTest-2085981255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:02:59 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-cf3a83ab-d98b-41fd-80ab-bdd935753b6f tempest-VolumesGetTest-2085981255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:02:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-cf3a83ab-d98b-41fd-80ab-bdd935753b6f tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cf3a83ab-d98b-41fd-80ab-bdd935753b6f tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:02:59 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:02:59 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:02:59 devstack sudo[88523]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ff7fadbd-92f9-4f1b-90ce-71d01461ec91 tempest-SnapshotsActionsTest-478601352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334" returned: 0 in 0.463s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ff7fadbd-92f9-4f1b-90ce-71d01461ec91 tempest-SnapshotsActionsTest-478601352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.158s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:02:59 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-ff7fadbd-92f9-4f1b-90ce-71d01461ec91 tempest-SnapshotsActionsTest-478601352 None] Create snapshot completed successfully Apr 16 23:02:59 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Apr 16 23:02:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-cf3a83ab-d98b-41fd-80ab-bdd935753b6f tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.450s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:02:59 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-cf3a83ab-d98b-41fd-80ab-bdd935753b6f tempest-VolumesGetTest-2085981255 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:02:59 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-cf3a83ab-d98b-41fd-80ab-bdd935753b6f tempest-VolumesGetTest-2085981255 None] Deleted volume successfully. Apr 16 23:02:59 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-cf3a83ab-d98b-41fd-80ab-bdd935753b6f tempest-VolumesGetTest-2085981255 None] Lock "cinder-6fa2cc9d-dcac-4e84-8d4d-aa12665bef8e-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-aa903a62-3cfc-47dd-84c8-cf53f1e56732 tempest-VolumesGetTest-2085981255 None] Acquiring lock "cinder-c76b961e-05b2-44fa-81ea-51417c268381-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-aa903a62-3cfc-47dd-84c8-cf53f1e56732 tempest-VolumesGetTest-2085981255 None] Lock "cinder-c76b961e-05b2-44fa-81ea-51417c268381-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-aa903a62-3cfc-47dd-84c8-cf53f1e56732 tempest-VolumesGetTest-2085981255 None] Acquiring lock "cinder-quobyte-c76b961e-05b2-44fa-81ea-51417c268381" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-aa903a62-3cfc-47dd-84c8-cf53f1e56732 tempest-VolumesGetTest-2085981255 None] Lock "cinder-quobyte-c76b961e-05b2-44fa-81ea-51417c268381" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:00 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[72971ef3-07be-4a16-87fb-9bc444f1cf4b]: (4, 'raw') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-aa903a62-3cfc-47dd-84c8-cf53f1e56732 tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-231b6f88-ff07-43d0-8ada-c4279fddb7db tempest-SnapshotsActionsTest-211388823 None] Acquiring lock "cinder-d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:00 devstack sudo[88532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381 Apr 16 23:03:00 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-231b6f88-ff07-43d0-8ada-c4279fddb7db tempest-SnapshotsActionsTest-211388823 None] Lock "cinder-d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-231b6f88-ff07-43d0-8ada-c4279fddb7db tempest-SnapshotsActionsTest-211388823 None] Acquiring lock "cinder-quobyte-d02c48b0-359b-41d3-9692-ece1f79bfa51" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-231b6f88-ff07-43d0-8ada-c4279fddb7db tempest-SnapshotsActionsTest-211388823 None] Lock "cinder-quobyte-d02c48b0-359b-41d3-9692-ece1f79bfa51" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-231b6f88-ff07-43d0-8ada-c4279fddb7db tempest-SnapshotsActionsTest-211388823 None] Acquiring lock "cinder-quobyte-d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-231b6f88-ff07-43d0-8ada-c4279fddb7db tempest-SnapshotsActionsTest-211388823 None] Lock "cinder-quobyte-d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:00 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-231b6f88-ff07-43d0-8ada-c4279fddb7db tempest-SnapshotsActionsTest-211388823 None] Deleting offline snapshot d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334 of volume d02c48b0-359b-41d3-9692-ece1f79bfa51 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:03:00 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-231b6f88-ff07-43d0-8ada-c4279fddb7db tempest-SnapshotsActionsTest-211388823 None] snapshot_file for this snap is: volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:03:00 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9580b2-85a7-442b-b5ce-85cec4620d96]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-231b6f88-ff07-43d0-8ada-c4279fddb7db tempest-SnapshotsActionsTest-211388823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:00 devstack sudo[88534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334 Apr 16 23:03:00 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:01 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-aa903a62-3cfc-47dd-84c8-cf53f1e56732 tempest-VolumesGetTest-2085981255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381" returned: 0 in 0.502s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-aa903a62-3cfc-47dd-84c8-cf53f1e56732 tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:01 devstack sudo[88538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381 Apr 16 23:03:01 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:01 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-231b6f88-ff07-43d0-8ada-c4279fddb7db tempest-SnapshotsActionsTest-211388823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334" returned: 0 in 0.513s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:01 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-231b6f88-ff07-43d0-8ada-c4279fddb7db tempest-SnapshotsActionsTest-211388823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d02c48b0-359b-41d3-9692-ece1f79bfa51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:03:01 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd4a4ca-25da-4a11-86fd-94cae206c71d]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-231b6f88-ff07-43d0-8ada-c4279fddb7db tempest-SnapshotsActionsTest-211388823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:01 devstack sudo[88543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 Apr 16 23:03:01 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:01 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-aa903a62-3cfc-47dd-84c8-cf53f1e56732 tempest-VolumesGetTest-2085981255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381" returned: 1 in 0.512s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-aa903a62-3cfc-47dd-84c8-cf53f1e56732 tempest-VolumesGetTest-2085981255 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381' failed. Not Retrying. {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 16 23:03:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-aa903a62-3cfc-47dd-84c8-cf53f1e56732 tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:01 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381 Apr 16 23:03:01 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:01 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-231b6f88-ff07-43d0-8ada-c4279fddb7db tempest-SnapshotsActionsTest-211388823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6" returned: 0 in 0.555s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:01 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-231b6f88-ff07-43d0-8ada-c4279fddb7db tempest-SnapshotsActionsTest-211388823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d02c48b0-359b-41d3-9692-ece1f79bfa51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:03:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-231b6f88-ff07-43d0-8ada-c4279fddb7db tempest-SnapshotsActionsTest-211388823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:01 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334 Apr 16 23:03:01 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:02 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-aa903a62-3cfc-47dd-84c8-cf53f1e56732 tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-c76b961e-05b2-44fa-81ea-51417c268381" returned: 0 in 0.454s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-aa903a62-3cfc-47dd-84c8-cf53f1e56732 tempest-VolumesGetTest-2085981255 None] Lock "cinder-quobyte-c76b961e-05b2-44fa-81ea-51417c268381" released by "delete_volume" :: held 1.523s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:02 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-aa903a62-3cfc-47dd-84c8-cf53f1e56732 tempest-VolumesGetTest-2085981255 None] Created reservations ['631313d4-c4af-4e15-bc4b-46692bed56a6', '105ee64b-e929-46fa-b046-b603abda865e', 'ff5d8a0d-e89b-42ee-bf35-c67961588e76', '3c64b3b8-0670-41c8-abd8-8e77c00ecf35'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:03:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-aa903a62-3cfc-47dd-84c8-cf53f1e56732 tempest-VolumesGetTest-2085981255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-aa903a62-3cfc-47dd-84c8-cf53f1e56732 tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:02 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-aa903a62-3cfc-47dd-84c8-cf53f1e56732 tempest-VolumesGetTest-2085981255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:03:02 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-aa903a62-3cfc-47dd-84c8-cf53f1e56732 tempest-VolumesGetTest-2085981255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:03:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-aa903a62-3cfc-47dd-84c8-cf53f1e56732 tempest-VolumesGetTest-2085981255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-aa903a62-3cfc-47dd-84c8-cf53f1e56732 tempest-VolumesGetTest-2085981255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:02 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:03:02 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:02 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-231b6f88-ff07-43d0-8ada-c4279fddb7db tempest-SnapshotsActionsTest-211388823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334" returned: 0 in 0.535s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-231b6f88-ff07-43d0-8ada-c4279fddb7db tempest-SnapshotsActionsTest-211388823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:02 devstack sudo[88562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334 Apr 16 23:03:02 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:02 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-aa903a62-3cfc-47dd-84c8-cf53f1e56732 tempest-VolumesGetTest-2085981255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.468s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:02 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-aa903a62-3cfc-47dd-84c8-cf53f1e56732 tempest-VolumesGetTest-2085981255 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:03:02 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-aa903a62-3cfc-47dd-84c8-cf53f1e56732 tempest-VolumesGetTest-2085981255 None] Deleted volume successfully. Apr 16 23:03:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-aa903a62-3cfc-47dd-84c8-cf53f1e56732 tempest-VolumesGetTest-2085981255 None] Lock "cinder-c76b961e-05b2-44fa-81ea-51417c268381-delete_volume" released by "delete_volume" :: held 2.148s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:02 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-231b6f88-ff07-43d0-8ada-c4279fddb7db tempest-SnapshotsActionsTest-211388823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334" returned: 0 in 0.456s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-231b6f88-ff07-43d0-8ada-c4279fddb7db tempest-SnapshotsActionsTest-211388823 None] Lock "cinder-quobyte-d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334" released by "_delete_snapshot" :: held 2.111s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-231b6f88-ff07-43d0-8ada-c4279fddb7db tempest-SnapshotsActionsTest-211388823 None] Lock "cinder-quobyte-d02c48b0-359b-41d3-9692-ece1f79bfa51" released by "delete_snapshot" :: held 2.129s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:02 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-231b6f88-ff07-43d0-8ada-c4279fddb7db tempest-SnapshotsActionsTest-211388823 None] Created reservations ['a8dca922-7134-46bc-aafd-45a87969ef71', '4ffdf44d-8ad2-430b-b3eb-ea20e55f5001', '81b03a95-df9b-47c2-8d24-6ea2d6d8059e', '80d23a5c-bf1c-405c-86f7-f4f1ecf3ba34'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:03:02 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-231b6f88-ff07-43d0-8ada-c4279fddb7db tempest-SnapshotsActionsTest-211388823 None] Delete snapshot completed successfully. Apr 16 23:03:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-231b6f88-ff07-43d0-8ada-c4279fddb7db tempest-SnapshotsActionsTest-211388823 None] Lock "cinder-d0ad1fd7-d3dd-49e2-9553-3f22bdcc7334-delete_snapshot" released by "delete_snapshot" :: held 2.225s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b6089700-1245-43bc-a06f-12dfa64f7ea7 tempest-SnapshotsActionsTest-478601352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b6089700-1245-43bc-a06f-12dfa64f7ea7 tempest-SnapshotsActionsTest-478601352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-b6089700-1245-43bc-a06f-12dfa64f7ea7 tempest-SnapshotsActionsTest-478601352 None] Creating offline snapshot bcaea0ad-1f87-4333-8ea6-00156ab17e58 of volume d02c48b0-359b-41d3-9692-ece1f79bfa51 {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca9b615-63f2-46ef-aafa-c9c4dc34b618]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b6089700-1245-43bc-a06f-12dfa64f7ea7 tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:04 devstack sudo[88567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 Apr 16 23:03:04 devstack sudo[88567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:04 devstack sudo[88567]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b6089700-1245-43bc-a06f-12dfa64f7ea7 tempest-SnapshotsActionsTest-478601352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6" returned: 0 in 0.535s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-b6089700-1245-43bc-a06f-12dfa64f7ea7 tempest-SnapshotsActionsTest-478601352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d02c48b0-359b-41d3-9692-ece1f79bfa51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b6089700-1245-43bc-a06f-12dfa64f7ea7 tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.bcaea0ad-1f87-4333-8ea6-00156ab17e58 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:04 devstack sudo[88572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.bcaea0ad-1f87-4333-8ea6-00156ab17e58 1G Apr 16 23:03:04 devstack sudo[88572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG oslo_service.periodic_task [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81971) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:03:04 devstack sudo[88574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:03:04 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Flow 'volume_create_manager' (1d973e0e-516e-44ad-80fb-6b56bf8b0702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0571fc76-f785-4d2c-a1cd-bab6b6d5166a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0571fc76-f785-4d2c-a1cd-bab6b6d5166a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-957021085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecaf0687-883e-4474-be1e-b1611164accf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c935f73833b843a7a02e576105b6fa32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:03:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:03:05Z,use_quota=True,user_id='37fa49650d8343d1925778a6b552ed13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f052352-54de-4206-9352-649def929245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f052352-54de-4206-9352-649def929245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d10a8cf9-6a99-48b8-b26c-d233ca7d5af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d10a8cf9-6a99-48b8-b26c-d233ca7d5af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecaf0687-883e-4474-be1e-b1611164accf', 'volume_name': 'volume-ecaf0687-883e-4474-be1e-b1611164accf', 'volume_size': 2}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca84945-0678-4841-adac-374f4a465495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca84945-0678-4841-adac-374f4a465495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14b49ff5-eb59-4cdf-a721-12474078f98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:04 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Volume ecaf0687-883e-4474-be1e-b1611164accf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecaf0687-883e-4474-be1e-b1611164accf', 'volume_size': 2} Apr 16 23:03:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:05 devstack sudo[88572]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b6089700-1245-43bc-a06f-12dfa64f7ea7 tempest-SnapshotsActionsTest-478601352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.bcaea0ad-1f87-4333-8ea6-00156ab17e58 1G" returned: 0 in 0.600s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b6089700-1245-43bc-a06f-12dfa64f7ea7 tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.bcaea0ad-1f87-4333-8ea6-00156ab17e58 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:05 devstack sudo[88580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.bcaea0ad-1f87-4333-8ea6-00156ab17e58 Apr 16 23:03:05 devstack sudo[88580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:05 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.496s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:05 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:03:05 devstack sudo[88580]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b6089700-1245-43bc-a06f-12dfa64f7ea7 tempest-SnapshotsActionsTest-478601352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.bcaea0ad-1f87-4333-8ea6-00156ab17e58" returned: 0 in 0.465s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:05 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-b6089700-1245-43bc-a06f-12dfa64f7ea7 tempest-SnapshotsActionsTest-478601352 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.bcaea0ad-1f87-4333-8ea6-00156ab17e58 is being set with open permissions: ugo+rw Apr 16 23:03:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b6089700-1245-43bc-a06f-12dfa64f7ea7 tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.bcaea0ad-1f87-4333-8ea6-00156ab17e58 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:05 devstack sudo[88585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.bcaea0ad-1f87-4333-8ea6-00156ab17e58 Apr 16 23:03:05 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:06 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b6089700-1245-43bc-a06f-12dfa64f7ea7 tempest-SnapshotsActionsTest-478601352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.bcaea0ad-1f87-4333-8ea6-00156ab17e58" returned: 0 in 0.456s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:06 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:INSERT=48,cinder:SELECT=154,cinder:UPDATE=158,cinder:DELETE=12 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 23:03:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b6089700-1245-43bc-a06f-12dfa64f7ea7 tempest-SnapshotsActionsTest-478601352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.124s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.317s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-957021085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecaf0687-883e-4474-be1e-b1611164accf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c935f73833b843a7a02e576105b6fa32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:03:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:03:05Z,use_quota=True,user_id='37fa49650d8343d1925778a6b552ed13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:03:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Creating volume ecaf0687-883e-4474-be1e-b1611164accf {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:03:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:03:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:03:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:03:06 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:03:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf 2147483648 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:06 devstack sudo[88588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf 2147483648 Apr 16 23:03:06 devstack sudo[88588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:06 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-b6089700-1245-43bc-a06f-12dfa64f7ea7 tempest-SnapshotsActionsTest-478601352 None] Create snapshot completed successfully Apr 16 23:03:06 devstack sudo[88588]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf 2147483648" returned: 0 in 0.554s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:06 devstack sudo[88593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf Apr 16 23:03:06 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:07 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf" returned: 0 in 0.448s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:03:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:07 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14b49ff5-eb59-4cdf-a721-12474078f98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecaf0687-883e-4474-be1e-b1611164accf', 'volume_size': 2}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:07 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a2bd66-5052-477f-9ff8-85ff16179ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:07 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Volume volume-ecaf0687-883e-4474-be1e-b1611164accf (ecaf0687-883e-4474-be1e-b1611164accf): created successfully Apr 16 23:03:07 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a2bd66-5052-477f-9ff8-85ff16179ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:07 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Flow 'volume_create_manager' (1d973e0e-516e-44ad-80fb-6b56bf8b0702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:03:07 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-5fb25bc9-6fa6-4246-9727-b0d67094cbd2 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Created volume successfully. Apr 16 23:03:07 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7b171a55-8e60-4181-be7a-0d16ec906024 tempest-SnapshotsActionsTest-211388823 None] Acquiring lock "cinder-bcaea0ad-1f87-4333-8ea6-00156ab17e58-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:07 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7b171a55-8e60-4181-be7a-0d16ec906024 tempest-SnapshotsActionsTest-211388823 None] Lock "cinder-bcaea0ad-1f87-4333-8ea6-00156ab17e58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:07 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7b171a55-8e60-4181-be7a-0d16ec906024 tempest-SnapshotsActionsTest-211388823 None] Acquiring lock "cinder-quobyte-d02c48b0-359b-41d3-9692-ece1f79bfa51" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:07 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7b171a55-8e60-4181-be7a-0d16ec906024 tempest-SnapshotsActionsTest-211388823 None] Lock "cinder-quobyte-d02c48b0-359b-41d3-9692-ece1f79bfa51" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:07 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7b171a55-8e60-4181-be7a-0d16ec906024 tempest-SnapshotsActionsTest-211388823 None] Acquiring lock "cinder-quobyte-bcaea0ad-1f87-4333-8ea6-00156ab17e58" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:07 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7b171a55-8e60-4181-be7a-0d16ec906024 tempest-SnapshotsActionsTest-211388823 None] Lock "cinder-quobyte-bcaea0ad-1f87-4333-8ea6-00156ab17e58" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-7b171a55-8e60-4181-be7a-0d16ec906024 tempest-SnapshotsActionsTest-211388823 None] Deleting offline snapshot bcaea0ad-1f87-4333-8ea6-00156ab17e58 of volume d02c48b0-359b-41d3-9692-ece1f79bfa51 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:03:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-7b171a55-8e60-4181-be7a-0d16ec906024 tempest-SnapshotsActionsTest-211388823 None] snapshot_file for this snap is: volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.bcaea0ad-1f87-4333-8ea6-00156ab17e58 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:03:07 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb454ca-39a0-413a-8a7b-bb8069295607]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7b171a55-8e60-4181-be7a-0d16ec906024 tempest-SnapshotsActionsTest-211388823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.bcaea0ad-1f87-4333-8ea6-00156ab17e58 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:07 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.bcaea0ad-1f87-4333-8ea6-00156ab17e58 Apr 16 23:03:07 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:07 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7b171a55-8e60-4181-be7a-0d16ec906024 tempest-SnapshotsActionsTest-211388823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.bcaea0ad-1f87-4333-8ea6-00156ab17e58" returned: 0 in 0.481s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-7b171a55-8e60-4181-be7a-0d16ec906024 tempest-SnapshotsActionsTest-211388823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d02c48b0-359b-41d3-9692-ece1f79bfa51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:03:07 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef5e2fe-8b47-4127-b315-9689bc457c94]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7b171a55-8e60-4181-be7a-0d16ec906024 tempest-SnapshotsActionsTest-211388823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:07 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 Apr 16 23:03:07 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1398b7f7-4ef5-4753-a803-ce8546f45736 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1398b7f7-4ef5-4753-a803-ce8546f45736 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:08 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-1398b7f7-4ef5-4753-a803-ce8546f45736 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Creating offline snapshot ed3bc3c7-4b1b-41a7-a8d0-813daebc8036 of volume ecaf0687-883e-4474-be1e-b1611164accf {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:03:08 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe827cf-e275-473e-a45f-0075f59cd348]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1398b7f7-4ef5-4753-a803-ce8546f45736 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:08 devstack sudo[88603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf Apr 16 23:03:08 devstack sudo[88603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:08 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7b171a55-8e60-4181-be7a-0d16ec906024 tempest-SnapshotsActionsTest-211388823 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6" returned: 0 in 0.591s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:08 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-7b171a55-8e60-4181-be7a-0d16ec906024 tempest-SnapshotsActionsTest-211388823 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d02c48b0-359b-41d3-9692-ece1f79bfa51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:03:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7b171a55-8e60-4181-be7a-0d16ec906024 tempest-SnapshotsActionsTest-211388823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.bcaea0ad-1f87-4333-8ea6-00156ab17e58 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:08 devstack sudo[88608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.bcaea0ad-1f87-4333-8ea6-00156ab17e58 Apr 16 23:03:08 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:08 devstack sudo[88603]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1398b7f7-4ef5-4753-a803-ce8546f45736 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf" returned: 0 in 0.554s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1398b7f7-4ef5-4753-a803-ce8546f45736 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.ed3bc3c7-4b1b-41a7-a8d0-813daebc8036 2G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:08 devstack sudo[88613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.ed3bc3c7-4b1b-41a7-a8d0-813daebc8036 2G Apr 16 23:03:08 devstack sudo[88613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:08 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7b171a55-8e60-4181-be7a-0d16ec906024 tempest-SnapshotsActionsTest-211388823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.bcaea0ad-1f87-4333-8ea6-00156ab17e58" returned: 0 in 0.543s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7b171a55-8e60-4181-be7a-0d16ec906024 tempest-SnapshotsActionsTest-211388823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.bcaea0ad-1f87-4333-8ea6-00156ab17e58 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:09 devstack sudo[88618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.bcaea0ad-1f87-4333-8ea6-00156ab17e58 Apr 16 23:03:09 devstack sudo[88618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:09 devstack sudo[88613]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1398b7f7-4ef5-4753-a803-ce8546f45736 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.ed3bc3c7-4b1b-41a7-a8d0-813daebc8036 2G" returned: 0 in 0.569s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1398b7f7-4ef5-4753-a803-ce8546f45736 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecaf0687-883e-4474-be1e-b1611164accf -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.ed3bc3c7-4b1b-41a7-a8d0-813daebc8036 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:09 devstack sudo[88623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecaf0687-883e-4474-be1e-b1611164accf -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.ed3bc3c7-4b1b-41a7-a8d0-813daebc8036 Apr 16 23:03:09 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:09 devstack sudo[88618]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7b171a55-8e60-4181-be7a-0d16ec906024 tempest-SnapshotsActionsTest-211388823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.bcaea0ad-1f87-4333-8ea6-00156ab17e58" returned: 0 in 0.489s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:09 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7b171a55-8e60-4181-be7a-0d16ec906024 tempest-SnapshotsActionsTest-211388823 None] Lock "cinder-quobyte-bcaea0ad-1f87-4333-8ea6-00156ab17e58" released by "_delete_snapshot" :: held 2.157s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:09 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7b171a55-8e60-4181-be7a-0d16ec906024 tempest-SnapshotsActionsTest-211388823 None] Lock "cinder-quobyte-d02c48b0-359b-41d3-9692-ece1f79bfa51" released by "delete_snapshot" :: held 2.172s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:09 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-7b171a55-8e60-4181-be7a-0d16ec906024 tempest-SnapshotsActionsTest-211388823 None] Created reservations ['45a628e9-2b00-4e0c-8026-b98764c03c81', 'bec954dd-b2f4-4d44-a0f3-c7ecb7eba789', '68d9d434-c15e-4341-a580-5cbd50e4d8d9', '4750236a-4466-491c-9725-351f6b331d59'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:03:09 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-7b171a55-8e60-4181-be7a-0d16ec906024 tempest-SnapshotsActionsTest-211388823 None] Delete snapshot completed successfully. Apr 16 23:03:09 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7b171a55-8e60-4181-be7a-0d16ec906024 tempest-SnapshotsActionsTest-211388823 None] Lock "cinder-bcaea0ad-1f87-4333-8ea6-00156ab17e58-delete_snapshot" released by "delete_snapshot" :: held 2.289s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:09 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1398b7f7-4ef5-4753-a803-ce8546f45736 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecaf0687-883e-4474-be1e-b1611164accf -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.ed3bc3c7-4b1b-41a7-a8d0-813daebc8036" returned: 0 in 0.501s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:09 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-1398b7f7-4ef5-4753-a803-ce8546f45736 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.ed3bc3c7-4b1b-41a7-a8d0-813daebc8036 is being set with open permissions: ugo+rw Apr 16 23:03:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1398b7f7-4ef5-4753-a803-ce8546f45736 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.ed3bc3c7-4b1b-41a7-a8d0-813daebc8036 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:09 devstack sudo[88629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.ed3bc3c7-4b1b-41a7-a8d0-813daebc8036 Apr 16 23:03:09 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:10 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1398b7f7-4ef5-4753-a803-ce8546f45736 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.ed3bc3c7-4b1b-41a7-a8d0-813daebc8036" returned: 0 in 0.445s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1398b7f7-4ef5-4753-a803-ce8546f45736 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:10 devstack sudo[88632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.info Apr 16 23:03:10 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:10 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1398b7f7-4ef5-4753-a803-ce8546f45736 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.info" returned: 0 in 0.537s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:10 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-1398b7f7-4ef5-4753-a803-ce8546f45736 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.info is being set with open permissions: ugo+rw Apr 16 23:03:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1398b7f7-4ef5-4753-a803-ce8546f45736 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:10 devstack sudo[88635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.info Apr 16 23:03:10 devstack sudo[88635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:10 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-0321a438-dfc9-40f6-8326-72bfd023dd3d tempest-SnapshotsActionsTest-478601352 None] Acquiring lock "cinder-d3797bcf-d0ec-4590-abb4-bdd527d667b6-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:10 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-0321a438-dfc9-40f6-8326-72bfd023dd3d tempest-SnapshotsActionsTest-478601352 None] Lock "cinder-d3797bcf-d0ec-4590-abb4-bdd527d667b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:10 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-0321a438-dfc9-40f6-8326-72bfd023dd3d tempest-SnapshotsActionsTest-478601352 None] Acquiring lock "cinder-quobyte-d02c48b0-359b-41d3-9692-ece1f79bfa51" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:10 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-0321a438-dfc9-40f6-8326-72bfd023dd3d tempest-SnapshotsActionsTest-478601352 None] Lock "cinder-quobyte-d02c48b0-359b-41d3-9692-ece1f79bfa51" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:10 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-0321a438-dfc9-40f6-8326-72bfd023dd3d tempest-SnapshotsActionsTest-478601352 None] Acquiring lock "cinder-quobyte-d3797bcf-d0ec-4590-abb4-bdd527d667b6" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:10 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-0321a438-dfc9-40f6-8326-72bfd023dd3d tempest-SnapshotsActionsTest-478601352 None] Lock "cinder-quobyte-d3797bcf-d0ec-4590-abb4-bdd527d667b6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-0321a438-dfc9-40f6-8326-72bfd023dd3d tempest-SnapshotsActionsTest-478601352 None] Deleting offline snapshot d3797bcf-d0ec-4590-abb4-bdd527d667b6 of volume d02c48b0-359b-41d3-9692-ece1f79bfa51 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:03:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-0321a438-dfc9-40f6-8326-72bfd023dd3d tempest-SnapshotsActionsTest-478601352 None] snapshot_file for this snap is: volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:03:10 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[6407b849-8240-4377-905e-2d67add99cbf]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0321a438-dfc9-40f6-8326-72bfd023dd3d tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:10 devstack sudo[88637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 Apr 16 23:03:10 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:11 devstack sudo[88635]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1398b7f7-4ef5-4753-a803-ce8546f45736 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.info" returned: 0 in 0.534s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1398b7f7-4ef5-4753-a803-ce8546f45736 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.199s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:11 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-1398b7f7-4ef5-4753-a803-ce8546f45736 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Create snapshot completed successfully Apr 16 23:03:11 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0321a438-dfc9-40f6-8326-72bfd023dd3d tempest-SnapshotsActionsTest-478601352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6" returned: 0 in 0.584s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-0321a438-dfc9-40f6-8326-72bfd023dd3d tempest-SnapshotsActionsTest-478601352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d02c48b0-359b-41d3-9692-ece1f79bfa51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:03:11 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb246ad-d32a-49d6-a178-2ded37d08c9f]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0321a438-dfc9-40f6-8326-72bfd023dd3d tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:11 devstack sudo[88643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51 Apr 16 23:03:11 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:12 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0321a438-dfc9-40f6-8326-72bfd023dd3d tempest-SnapshotsActionsTest-478601352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51" returned: 0 in 0.562s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0321a438-dfc9-40f6-8326-72bfd023dd3d tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:12 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 Apr 16 23:03:12 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:12 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8c36c032-52b0-4835-a5d3-3bf309f8f8d4 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Acquiring lock "cinder-ed3bc3c7-4b1b-41a7-a8d0-813daebc8036-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:12 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8c36c032-52b0-4835-a5d3-3bf309f8f8d4 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Lock "cinder-ed3bc3c7-4b1b-41a7-a8d0-813daebc8036-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:12 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8c36c032-52b0-4835-a5d3-3bf309f8f8d4 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Acquiring lock "cinder-quobyte-ecaf0687-883e-4474-be1e-b1611164accf" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:12 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8c36c032-52b0-4835-a5d3-3bf309f8f8d4 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Lock "cinder-quobyte-ecaf0687-883e-4474-be1e-b1611164accf" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:12 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8c36c032-52b0-4835-a5d3-3bf309f8f8d4 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Acquiring lock "cinder-quobyte-ed3bc3c7-4b1b-41a7-a8d0-813daebc8036" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:12 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8c36c032-52b0-4835-a5d3-3bf309f8f8d4 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Lock "cinder-quobyte-ed3bc3c7-4b1b-41a7-a8d0-813daebc8036" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-8c36c032-52b0-4835-a5d3-3bf309f8f8d4 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Deleting offline snapshot ed3bc3c7-4b1b-41a7-a8d0-813daebc8036 of volume ecaf0687-883e-4474-be1e-b1611164accf {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:03:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-8c36c032-52b0-4835-a5d3-3bf309f8f8d4 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] snapshot_file for this snap is: volume-ecaf0687-883e-4474-be1e-b1611164accf.ed3bc3c7-4b1b-41a7-a8d0-813daebc8036 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:03:12 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[52701851-2eb6-45b7-a077-68056a04c64e]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8c36c032-52b0-4835-a5d3-3bf309f8f8d4 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.ed3bc3c7-4b1b-41a7-a8d0-813daebc8036 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:12 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.ed3bc3c7-4b1b-41a7-a8d0-813daebc8036 Apr 16 23:03:12 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:12 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0321a438-dfc9-40f6-8326-72bfd023dd3d tempest-SnapshotsActionsTest-478601352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6" returned: 0 in 0.596s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0321a438-dfc9-40f6-8326-72bfd023dd3d tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:12 devstack sudo[88657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6 Apr 16 23:03:12 devstack sudo[88657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:12 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8c36c032-52b0-4835-a5d3-3bf309f8f8d4 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.ed3bc3c7-4b1b-41a7-a8d0-813daebc8036" returned: 0 in 0.535s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-8c36c032-52b0-4835-a5d3-3bf309f8f8d4 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecaf0687-883e-4474-be1e-b1611164accf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:03:12 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e3da90-a7bf-4f2c-b545-e37bd53f1cec]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8c36c032-52b0-4835-a5d3-3bf309f8f8d4 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:13 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf Apr 16 23:03:13 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:13 devstack sudo[88657]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0321a438-dfc9-40f6-8326-72bfd023dd3d tempest-SnapshotsActionsTest-478601352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51.d3797bcf-d0ec-4590-abb4-bdd527d667b6" returned: 0 in 0.454s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:13 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-0321a438-dfc9-40f6-8326-72bfd023dd3d tempest-SnapshotsActionsTest-478601352 None] Lock "cinder-quobyte-d3797bcf-d0ec-4590-abb4-bdd527d667b6" released by "_delete_snapshot" :: held 2.282s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:13 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-0321a438-dfc9-40f6-8326-72bfd023dd3d tempest-SnapshotsActionsTest-478601352 None] Lock "cinder-quobyte-d02c48b0-359b-41d3-9692-ece1f79bfa51" released by "delete_snapshot" :: held 2.303s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:13 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-0321a438-dfc9-40f6-8326-72bfd023dd3d tempest-SnapshotsActionsTest-478601352 None] Created reservations ['f92866ad-1539-40f2-8979-57baabdb5343', '3d38812f-524b-45fa-8934-08456173740d', '2aa2ce79-2f0d-4121-8f08-8dfcf6262237', 'f5976c8f-6c3c-49fc-b912-33bfb9e988cf'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:03:13 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-0321a438-dfc9-40f6-8326-72bfd023dd3d tempest-SnapshotsActionsTest-478601352 None] Delete snapshot completed successfully. Apr 16 23:03:13 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-0321a438-dfc9-40f6-8326-72bfd023dd3d tempest-SnapshotsActionsTest-478601352 None] Lock "cinder-d3797bcf-d0ec-4590-abb4-bdd527d667b6-delete_snapshot" released by "delete_snapshot" :: held 2.461s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:13 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8c36c032-52b0-4835-a5d3-3bf309f8f8d4 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf" returned: 0 in 0.573s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8c36c032-52b0-4835-a5d3-3bf309f8f8d4 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.ed3bc3c7-4b1b-41a7-a8d0-813daebc8036 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:13 devstack sudo[88668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.ed3bc3c7-4b1b-41a7-a8d0-813daebc8036 Apr 16 23:03:13 devstack sudo[88668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:14 devstack sudo[88668]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8c36c032-52b0-4835-a5d3-3bf309f8f8d4 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.ed3bc3c7-4b1b-41a7-a8d0-813daebc8036" returned: 0 in 0.492s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8c36c032-52b0-4835-a5d3-3bf309f8f8d4 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.ed3bc3c7-4b1b-41a7-a8d0-813daebc8036 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-074bcee5-7a4d-4c13-918a-451259c150b3 tempest-SnapshotsActionsTest-478601352 None] Acquiring lock "cinder-d02c48b0-359b-41d3-9692-ece1f79bfa51-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:14 devstack sudo[88673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.ed3bc3c7-4b1b-41a7-a8d0-813daebc8036 Apr 16 23:03:14 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-074bcee5-7a4d-4c13-918a-451259c150b3 tempest-SnapshotsActionsTest-478601352 None] Lock "cinder-d02c48b0-359b-41d3-9692-ece1f79bfa51-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-074bcee5-7a4d-4c13-918a-451259c150b3 tempest-SnapshotsActionsTest-478601352 None] Acquiring lock "cinder-quobyte-d02c48b0-359b-41d3-9692-ece1f79bfa51" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-074bcee5-7a4d-4c13-918a-451259c150b3 tempest-SnapshotsActionsTest-478601352 None] Lock "cinder-quobyte-d02c48b0-359b-41d3-9692-ece1f79bfa51" acquired by "delete_volume" :: waited 0.007s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:14 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[167fbca6-6c01-45d3-8d8c-342852904327]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-074bcee5-7a4d-4c13-918a-451259c150b3 tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:14 devstack sudo[88675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51 Apr 16 23:03:14 devstack sudo[88675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:14 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8c36c032-52b0-4835-a5d3-3bf309f8f8d4 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf.ed3bc3c7-4b1b-41a7-a8d0-813daebc8036" returned: 0 in 0.494s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8c36c032-52b0-4835-a5d3-3bf309f8f8d4 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Lock "cinder-quobyte-ed3bc3c7-4b1b-41a7-a8d0-813daebc8036" released by "_delete_snapshot" :: held 2.167s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8c36c032-52b0-4835-a5d3-3bf309f8f8d4 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Lock "cinder-quobyte-ecaf0687-883e-4474-be1e-b1611164accf" released by "delete_snapshot" :: held 2.186s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:14 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-8c36c032-52b0-4835-a5d3-3bf309f8f8d4 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Created reservations ['de1a7947-674d-4f5c-ac93-3046c569c354', '4ae7704b-0088-4232-87d7-bc1650fc9f24', '936606a4-116a-46de-b234-1c0ac3dc428e', '2698427d-e076-4366-ae6f-3f22fe4ce4fc'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:03:14 devstack sudo[88675]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-074bcee5-7a4d-4c13-918a-451259c150b3 tempest-SnapshotsActionsTest-478601352 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51" returned: 0 in 0.520s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-074bcee5-7a4d-4c13-918a-451259c150b3 tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:14 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51 Apr 16 23:03:14 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:14 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-8c36c032-52b0-4835-a5d3-3bf309f8f8d4 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Delete snapshot completed successfully. Apr 16 23:03:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8c36c032-52b0-4835-a5d3-3bf309f8f8d4 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Lock "cinder-ed3bc3c7-4b1b-41a7-a8d0-813daebc8036-delete_snapshot" released by "delete_snapshot" :: held 2.332s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:15 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-074bcee5-7a4d-4c13-918a-451259c150b3 tempest-SnapshotsActionsTest-478601352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d02c48b0-359b-41d3-9692-ece1f79bfa51" returned: 0 in 0.581s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:15 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-074bcee5-7a4d-4c13-918a-451259c150b3 tempest-SnapshotsActionsTest-478601352 None] Lock "cinder-quobyte-d02c48b0-359b-41d3-9692-ece1f79bfa51" released by "delete_volume" :: held 1.134s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:15 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-074bcee5-7a4d-4c13-918a-451259c150b3 tempest-SnapshotsActionsTest-478601352 None] Created reservations ['b8cff0e8-4cd6-48b9-92ab-779f509e5931', '810df457-539f-40b4-9a23-feb0953c473c', '631c5e32-29d5-4b62-91b0-77ceca768746', '7291a97d-710d-4757-89c9-647883a3722c'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:03:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-074bcee5-7a4d-4c13-918a-451259c150b3 tempest-SnapshotsActionsTest-478601352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-074bcee5-7a4d-4c13-918a-451259c150b3 tempest-SnapshotsActionsTest-478601352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-074bcee5-7a4d-4c13-918a-451259c150b3 tempest-SnapshotsActionsTest-478601352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:03:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-074bcee5-7a4d-4c13-918a-451259c150b3 tempest-SnapshotsActionsTest-478601352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:03:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-074bcee5-7a4d-4c13-918a-451259c150b3 tempest-SnapshotsActionsTest-478601352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-074bcee5-7a4d-4c13-918a-451259c150b3 tempest-SnapshotsActionsTest-478601352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:15 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:03:15 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:15 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e763388c-255b-4255-b49a-a5a7fb697be5 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Acquiring lock "cinder-ecaf0687-883e-4474-be1e-b1611164accf-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:15 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e763388c-255b-4255-b49a-a5a7fb697be5 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Lock "cinder-ecaf0687-883e-4474-be1e-b1611164accf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:15 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:SELECT=145,cinder:INSERT=51,cinder:UPDATE=172,cinder:DELETE=10 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 23:03:15 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e763388c-255b-4255-b49a-a5a7fb697be5 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Acquiring lock "cinder-quobyte-ecaf0687-883e-4474-be1e-b1611164accf" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:15 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e763388c-255b-4255-b49a-a5a7fb697be5 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Lock "cinder-quobyte-ecaf0687-883e-4474-be1e-b1611164accf" acquired by "delete_volume" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:15 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fea907-858e-47a7-b5a3-a1d33ebd7458]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e763388c-255b-4255-b49a-a5a7fb697be5 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:15 devstack sudo[88686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf Apr 16 23:03:15 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:15 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-074bcee5-7a4d-4c13-918a-451259c150b3 tempest-SnapshotsActionsTest-478601352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.470s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:15 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-074bcee5-7a4d-4c13-918a-451259c150b3 tempest-SnapshotsActionsTest-478601352 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:03:15 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-074bcee5-7a4d-4c13-918a-451259c150b3 tempest-SnapshotsActionsTest-478601352 None] Deleted volume successfully. Apr 16 23:03:15 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-074bcee5-7a4d-4c13-918a-451259c150b3 tempest-SnapshotsActionsTest-478601352 None] Lock "cinder-d02c48b0-359b-41d3-9692-ece1f79bfa51-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:16 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e763388c-255b-4255-b49a-a5a7fb697be5 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf" returned: 0 in 0.644s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e763388c-255b-4255-b49a-a5a7fb697be5 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:16 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf Apr 16 23:03:16 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:16 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e763388c-255b-4255-b49a-a5a7fb697be5 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ecaf0687-883e-4474-be1e-b1611164accf" returned: 0 in 0.480s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:16 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e763388c-255b-4255-b49a-a5a7fb697be5 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Lock "cinder-quobyte-ecaf0687-883e-4474-be1e-b1611164accf" released by "delete_volume" :: held 1.161s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:16 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-e763388c-255b-4255-b49a-a5a7fb697be5 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Created reservations ['584947f9-1f86-45c9-88c5-038aefae9f5d', 'bb5aeae2-9e47-43fe-be6b-a6c3eea6a6c6', '646c9e17-bee5-4cbc-acae-4a40b35c738a', 'c3c2d25f-9be6-420a-9f76-0ecfd4d190a9'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:03:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e763388c-255b-4255-b49a-a5a7fb697be5 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e763388c-255b-4255-b49a-a5a7fb697be5 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:16 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e763388c-255b-4255-b49a-a5a7fb697be5 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:03:16 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e763388c-255b-4255-b49a-a5a7fb697be5 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:03:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e763388c-255b-4255-b49a-a5a7fb697be5 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e763388c-255b-4255-b49a-a5a7fb697be5 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:16 devstack sudo[88695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:03:16 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:17 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e763388c-255b-4255-b49a-a5a7fb697be5 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.488s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:17 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-e763388c-255b-4255-b49a-a5a7fb697be5 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:03:17 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-e763388c-255b-4255-b49a-a5a7fb697be5 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Deleted volume successfully. Apr 16 23:03:17 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e763388c-255b-4255-b49a-a5a7fb697be5 tempest-VolumesSnapshotNegativeTestJSON-1106632142 None] Lock "cinder-ecaf0687-883e-4474-be1e-b1611164accf-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:20 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:03:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Flow 'volume_create_manager' (ff91c8d5-9784-4494-bb6f-23de93f60a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:03:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6331a6-3513-4cc5-a641-8ced98167dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec6331a6-3513-4cc5-a641-8ced98167dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1500470853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2933749f-c193-42bb-82a4-fc162cad0285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fade8537aa824b2abae98c550d79cade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:03:20Z,use_quota=True,user_id='8cdc660fcb944b6db5560c45c1ed6150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5f25e3-b7a8-4bb1-9aeb-39b090deeb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac5f25e3-b7a8-4bb1-9aeb-39b090deeb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d469dad-8c59-4b7e-a2fb-e1925aaac364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d469dad-8c59-4b7e-a2fb-e1925aaac364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2933749f-c193-42bb-82a4-fc162cad0285', 'volume_name': 'volume-2933749f-c193-42bb-82a4-fc162cad0285', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d936a50-4c92-4de4-a3b6-75cfdeee4af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d936a50-4c92-4de4-a3b6-75cfdeee4af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95dc4e94-8fbe-4d64-a8df-bf45b51b8183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:20 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Volume 2933749f-c193-42bb-82a4-fc162cad0285: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2933749f-c193-42bb-82a4-fc162cad0285', 'volume_size': 1} Apr 16 23:03:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:20 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1500470853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2933749f-c193-42bb-82a4-fc162cad0285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fade8537aa824b2abae98c550d79cade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:03:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:03:20Z,use_quota=True,user_id='8cdc660fcb944b6db5560c45c1ed6150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:03:20 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Creating volume 2933749f-c193-42bb-82a4-fc162cad0285 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:03:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:20 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:03:20 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:03:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:20 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:03:20 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:03:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:20 devstack sudo[88699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285 1073741824 Apr 16 23:03:20 devstack sudo[88699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:20 devstack sudo[88699]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285 1073741824" returned: 0 in 0.483s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:20 devstack sudo[88704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285 Apr 16 23:03:20 devstack sudo[88704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:21 devstack sudo[88704]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285" returned: 0 in 0.420s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:03:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:21 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95dc4e94-8fbe-4d64-a8df-bf45b51b8183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2933749f-c193-42bb-82a4-fc162cad0285', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:21 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47c2781-a21d-4a96-a243-2801f355185c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:21 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Volume volume-2933749f-c193-42bb-82a4-fc162cad0285 (2933749f-c193-42bb-82a4-fc162cad0285): created successfully Apr 16 23:03:21 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b47c2781-a21d-4a96-a243-2801f355185c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:21 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Flow 'volume_create_manager' (ff91c8d5-9784-4494-bb6f-23de93f60a0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:03:21 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-c7e57a9a-5130-4e98-a3bb-38648d80bca9 tempest-VolumeDependencyTests-1245527214 None] Created volume successfully. Apr 16 23:03:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-4cb45e97-1fc4-4274-abfe-5ae2c4a6354f tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-4cb45e97-1fc4-4274-abfe-5ae2c4a6354f tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:22 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-4cb45e97-1fc4-4274-abfe-5ae2c4a6354f tempest-VolumeDependencyTests-1245527214 None] Creating offline snapshot 01b831e8-4fda-471e-9c5c-5a6a17295fe5 of volume 2933749f-c193-42bb-82a4-fc162cad0285 {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:03:22 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a7df66-07d2-41db-9957-e3dbc309a491]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4cb45e97-1fc4-4274-abfe-5ae2c4a6354f tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:22 devstack sudo[88708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285 Apr 16 23:03:22 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:22 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4cb45e97-1fc4-4274-abfe-5ae2c4a6354f tempest-VolumeDependencyTests-1245527214 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285" returned: 0 in 0.539s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4cb45e97-1fc4-4274-abfe-5ae2c4a6354f tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.01b831e8-4fda-471e-9c5c-5a6a17295fe5 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:22 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.01b831e8-4fda-471e-9c5c-5a6a17295fe5 1G Apr 16 23:03:22 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:23 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4cb45e97-1fc4-4274-abfe-5ae2c4a6354f tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.01b831e8-4fda-471e-9c5c-5a6a17295fe5 1G" returned: 0 in 0.629s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4cb45e97-1fc4-4274-abfe-5ae2c4a6354f tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2933749f-c193-42bb-82a4-fc162cad0285 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.01b831e8-4fda-471e-9c5c-5a6a17295fe5 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:23 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2933749f-c193-42bb-82a4-fc162cad0285 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.01b831e8-4fda-471e-9c5c-5a6a17295fe5 Apr 16 23:03:23 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:24 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4cb45e97-1fc4-4274-abfe-5ae2c4a6354f tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2933749f-c193-42bb-82a4-fc162cad0285 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.01b831e8-4fda-471e-9c5c-5a6a17295fe5" returned: 0 in 0.587s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:24 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-4cb45e97-1fc4-4274-abfe-5ae2c4a6354f tempest-VolumeDependencyTests-1245527214 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.01b831e8-4fda-471e-9c5c-5a6a17295fe5 is being set with open permissions: ugo+rw Apr 16 23:03:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4cb45e97-1fc4-4274-abfe-5ae2c4a6354f tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.01b831e8-4fda-471e-9c5c-5a6a17295fe5 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:24 devstack sudo[88723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.01b831e8-4fda-471e-9c5c-5a6a17295fe5 Apr 16 23:03:24 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:24 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4cb45e97-1fc4-4274-abfe-5ae2c4a6354f tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.01b831e8-4fda-471e-9c5c-5a6a17295fe5" returned: 0 in 0.443s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4cb45e97-1fc4-4274-abfe-5ae2c4a6354f tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:24 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.info Apr 16 23:03:24 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:25 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4cb45e97-1fc4-4274-abfe-5ae2c4a6354f tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.info" returned: 0 in 0.497s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:25 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-4cb45e97-1fc4-4274-abfe-5ae2c4a6354f tempest-VolumeDependencyTests-1245527214 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.info is being set with open permissions: ugo+rw Apr 16 23:03:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4cb45e97-1fc4-4274-abfe-5ae2c4a6354f tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:25 devstack sudo[88729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.info Apr 16 23:03:25 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:25 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4cb45e97-1fc4-4274-abfe-5ae2c4a6354f tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.info" returned: 0 in 0.477s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-4cb45e97-1fc4-4274-abfe-5ae2c4a6354f tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.236s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:25 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-4cb45e97-1fc4-4274-abfe-5ae2c4a6354f tempest-VolumeDependencyTests-1245527214 None] Create snapshot completed successfully Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Flow 'volume_create_manager' (37fca9aa-aec9-41ea-a7d3-06ba4a92a591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587f38be-d512-4602-ab4b-7cfeaff535e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587f38be-d512-4602-ab4b-7cfeaff535e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:03:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1537226245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fade8537aa824b2abae98c550d79cade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=01b831e8-4fda-471e-9c5c-5a6a17295fe5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:03:27Z,use_quota=True,user_id='8cdc660fcb944b6db5560c45c1ed6150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa2f842-2487-485a-b406-b0c87b63d521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa2f842-2487-485a-b406-b0c87b63d521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad3b2f9-2f62-49f5-977a-44d2348cf186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ad3b2f9-2f62-49f5-977a-44d2348cf186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836', 'volume_name': 'volume-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836', 'volume_size': 1, 'snapshot_id': '01b831e8-4fda-471e-9c5c-5a6a17295fe5'}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73a4491-e354-4691-ac67-1e0a8d5fc4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c73a4491-e354-4691-ac67-1e0a8d5fc4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eb36583-6445-4880-a813-35233ffd761b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:26 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Volume 38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836', 'volume_size': 1, 'snapshot_id': '01b831e8-4fda-471e-9c5c-5a6a17295fe5'} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "cinder-quobyte-01b831e8-4fda-471e-9c5c-5a6a17295fe5-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836" by "_create_volume_from_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-quobyte-01b831e8-4fda-471e-9c5c-5a6a17295fe5-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Creating volume 38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836 from snapshot 01b831e8-4fda-471e-9c5c-5a6a17295fe5 {{(pid=81971) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "cinder-quobyte-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836" by "_copy_volume_from_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-quobyte-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] snapshot: 01b831e8-4fda-471e-9c5c-5a6a17295fe5, volume: 38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836, {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b34285d-cd6e-43ea-8892-5bb344fcd434]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.01b831e8-4fda-471e-9c5c-5a6a17295fe5 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:27 devstack sudo[88732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.01b831e8-4fda-471e-9c5c-5a6a17295fe5 Apr 16 23:03:27 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:27 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.01b831e8-4fda-471e-9c5c-5a6a17295fe5" returned: 0 in 0.566s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:27 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2933749f-c193-42bb-82a4-fc162cad0285(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:03:27 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285 {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 23:03:27 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Creating direct copy from snapshot {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 23:03:27 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[90196233-287d-4302-a28f-837042c82a26]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:27 devstack sudo[88737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285 Apr 16 23:03:27 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:28 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285" returned: 0 in 0.636s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:28 devstack cinder-volume[81971]: DEBUG cinder.utils [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Path /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836 not found in is_blk_device check {{(pid=81971) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 23:03:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:28 devstack sudo[88742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836 Apr 16 23:03:28 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:31 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836" returned: 0 in 3.123s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:31 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf8aef4-fb13-4839-be80-424151a2f6ea]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:31 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285 Apr 16 23:03:31 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:32 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285" returned: 0 in 0.946s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Image conversion details: src /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285, size 1024.00 MB, duration 3.12 sec, destination /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836 {{(pid=81971) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 23:03:32 devstack cinder-volume[81971]: INFO cinder.image.image_utils [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Converted 1024.00 MB image at 327.71 MB/s Apr 16 23:03:32 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836 is being set with open permissions: ugo+rw Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:32 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836 Apr 16 23:03:32 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Flow 'volume_create_manager' (361bcbd1-e921-4719-b20c-89650bc4bdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a5b00c-9adf-4c4b-b762-d0a51324ef51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a5b00c-9adf-4c4b-b762-d0a51324ef51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1137628908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a2703f3-96b7-4856-8806-62a90a179071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0aafbb52ba469aabea196c7c7077f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:03:33Z,use_quota=True,user_id='610cfb769a034e108e3ea5ab94b393aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f86bfaf8-327f-4f97-8ae0-46a46bb0c82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f86bfaf8-327f-4f97-8ae0-46a46bb0c82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549b3fab-bc27-4451-86f2-649628ff96a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (549b3fab-bc27-4451-86f2-649628ff96a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a2703f3-96b7-4856-8806-62a90a179071', 'volume_name': 'volume-2a2703f3-96b7-4856-8806-62a90a179071', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82833257-0342-4476-a41f-7ddc4db180cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82833257-0342-4476-a41f-7ddc4db180cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903648f9-c42e-42a3-b324-85114ed513ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:32 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Volume 2a2703f3-96b7-4856-8806-62a90a179071: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a2703f3-96b7-4856-8806-62a90a179071', 'volume_size': 1} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:32 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836" returned: 0 in 0.579s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-quobyte-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836" released by "_copy_volume_from_snapshot" :: held 5.917s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-quobyte-01b831e8-4fda-471e-9c5c-5a6a17295fe5-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836" released by "_create_volume_from_snapshot" :: held 5.934s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.944s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.050s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:03:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1137628908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a2703f3-96b7-4856-8806-62a90a179071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0aafbb52ba469aabea196c7c7077f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:03:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:03:33Z,use_quota=True,user_id='610cfb769a034e108e3ea5ab94b393aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Creating volume 2a2703f3-96b7-4856-8806-62a90a179071 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:03:32 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2a2703f3-96b7-4856-8806-62a90a179071 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:32 devstack sudo[88763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2a2703f3-96b7-4856-8806-62a90a179071 1073741824 Apr 16 23:03:32 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eb36583-6445-4880-a813-35233ffd761b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836', 'volume_size': 1, 'snapshot_id': '01b831e8-4fda-471e-9c5c-5a6a17295fe5'}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6445a5a8-94bd-4a6b-8e3e-ac7f750bc772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:32 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Volume volume-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836 (38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836): created successfully Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6445a5a8-94bd-4a6b-8e3e-ac7f750bc772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Flow 'volume_create_manager' (37fca9aa-aec9-41ea-a7d3-06ba4a92a591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:03:32 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-1caf2ef8-136e-4e85-b0ce-512b574cb142 tempest-VolumeDependencyTests-1245527214 None] Created volume successfully. Apr 16 23:03:33 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a5bb99f5-3cbb-4ae8-bfc9-9518a3d3b59e tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "cinder-01b831e8-4fda-471e-9c5c-5a6a17295fe5-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:33 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a5bb99f5-3cbb-4ae8-bfc9-9518a3d3b59e tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-01b831e8-4fda-471e-9c5c-5a6a17295fe5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:33 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a5bb99f5-3cbb-4ae8-bfc9-9518a3d3b59e tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "cinder-quobyte-2933749f-c193-42bb-82a4-fc162cad0285" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:33 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a5bb99f5-3cbb-4ae8-bfc9-9518a3d3b59e tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-quobyte-2933749f-c193-42bb-82a4-fc162cad0285" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:33 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a5bb99f5-3cbb-4ae8-bfc9-9518a3d3b59e tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "cinder-quobyte-01b831e8-4fda-471e-9c5c-5a6a17295fe5" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:33 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a5bb99f5-3cbb-4ae8-bfc9-9518a3d3b59e tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-quobyte-01b831e8-4fda-471e-9c5c-5a6a17295fe5" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-a5bb99f5-3cbb-4ae8-bfc9-9518a3d3b59e tempest-VolumeDependencyTests-1245527214 None] Deleting offline snapshot 01b831e8-4fda-471e-9c5c-5a6a17295fe5 of volume 2933749f-c193-42bb-82a4-fc162cad0285 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:03:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-a5bb99f5-3cbb-4ae8-bfc9-9518a3d3b59e tempest-VolumeDependencyTests-1245527214 None] snapshot_file for this snap is: volume-2933749f-c193-42bb-82a4-fc162cad0285.01b831e8-4fda-471e-9c5c-5a6a17295fe5 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:03:33 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[84604fae-8e2a-4942-9371-928e3f749b8a]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a5bb99f5-3cbb-4ae8-bfc9-9518a3d3b59e tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.01b831e8-4fda-471e-9c5c-5a6a17295fe5 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:33 devstack sudo[88767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.01b831e8-4fda-471e-9c5c-5a6a17295fe5 Apr 16 23:03:33 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:33 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2a2703f3-96b7-4856-8806-62a90a179071 1073741824" returned: 0 in 0.896s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2a2703f3-96b7-4856-8806-62a90a179071 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:33 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2a2703f3-96b7-4856-8806-62a90a179071 Apr 16 23:03:33 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:34 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a5bb99f5-3cbb-4ae8-bfc9-9518a3d3b59e tempest-VolumeDependencyTests-1245527214 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.01b831e8-4fda-471e-9c5c-5a6a17295fe5" returned: 0 in 0.736s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:34 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-a5bb99f5-3cbb-4ae8-bfc9-9518a3d3b59e tempest-VolumeDependencyTests-1245527214 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2933749f-c193-42bb-82a4-fc162cad0285(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:03:34 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f06dbb-fac0-4f23-8501-1f5f2d4e13f6]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a5bb99f5-3cbb-4ae8-bfc9-9518a3d3b59e tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:34 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285 Apr 16 23:03:34 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:34 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2a2703f3-96b7-4856-8806-62a90a179071" returned: 0 in 0.702s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:34 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:03:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903648f9-c42e-42a3-b324-85114ed513ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a2703f3-96b7-4856-8806-62a90a179071', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd435297-bb98-4133-956d-42488fc94b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:34 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Volume volume-2a2703f3-96b7-4856-8806-62a90a179071 (2a2703f3-96b7-4856-8806-62a90a179071): created successfully Apr 16 23:03:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd435297-bb98-4133-956d-42488fc94b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Flow 'volume_create_manager' (361bcbd1-e921-4719-b20c-89650bc4bdc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:03:34 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-91be8c1d-0c4a-4838-84af-f853a228765c tempest-VolumesServicesTestJSON-358380302 None] Created volume successfully. Apr 16 23:03:34 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a5bb99f5-3cbb-4ae8-bfc9-9518a3d3b59e tempest-VolumeDependencyTests-1245527214 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285" returned: 0 in 0.512s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a5bb99f5-3cbb-4ae8-bfc9-9518a3d3b59e tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.01b831e8-4fda-471e-9c5c-5a6a17295fe5 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:34 devstack sudo[88781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.01b831e8-4fda-471e-9c5c-5a6a17295fe5 Apr 16 23:03:34 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:34 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-49cfefd1-9c0c-4705-9b40-01f8873f509c tempest-VolumesServicesTestJSON-358380302 None] Acquiring lock "cinder-2a2703f3-96b7-4856-8806-62a90a179071-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:34 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-49cfefd1-9c0c-4705-9b40-01f8873f509c tempest-VolumesServicesTestJSON-358380302 None] Lock "cinder-2a2703f3-96b7-4856-8806-62a90a179071-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:35 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-49cfefd1-9c0c-4705-9b40-01f8873f509c tempest-VolumesServicesTestJSON-358380302 None] Acquiring lock "cinder-quobyte-2a2703f3-96b7-4856-8806-62a90a179071" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:35 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-49cfefd1-9c0c-4705-9b40-01f8873f509c tempest-VolumesServicesTestJSON-358380302 None] Lock "cinder-quobyte-2a2703f3-96b7-4856-8806-62a90a179071" acquired by "delete_volume" :: waited 0.008s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:35 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc566f7-d758-40ac-abe1-db90f272a28a]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-49cfefd1-9c0c-4705-9b40-01f8873f509c tempest-VolumesServicesTestJSON-358380302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2a2703f3-96b7-4856-8806-62a90a179071 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:35 devstack sudo[88783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2a2703f3-96b7-4856-8806-62a90a179071 Apr 16 23:03:35 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:35 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a5bb99f5-3cbb-4ae8-bfc9-9518a3d3b59e tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.01b831e8-4fda-471e-9c5c-5a6a17295fe5" returned: 0 in 0.498s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a5bb99f5-3cbb-4ae8-bfc9-9518a3d3b59e tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.01b831e8-4fda-471e-9c5c-5a6a17295fe5 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:35 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.01b831e8-4fda-471e-9c5c-5a6a17295fe5 Apr 16 23:03:35 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:35 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-49cfefd1-9c0c-4705-9b40-01f8873f509c tempest-VolumesServicesTestJSON-358380302 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2a2703f3-96b7-4856-8806-62a90a179071" returned: 0 in 0.497s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-49cfefd1-9c0c-4705-9b40-01f8873f509c tempest-VolumesServicesTestJSON-358380302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2a2703f3-96b7-4856-8806-62a90a179071 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:35 devstack sudo[88793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2a2703f3-96b7-4856-8806-62a90a179071 Apr 16 23:03:35 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:35 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a5bb99f5-3cbb-4ae8-bfc9-9518a3d3b59e tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285.01b831e8-4fda-471e-9c5c-5a6a17295fe5" returned: 0 in 0.467s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:35 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a5bb99f5-3cbb-4ae8-bfc9-9518a3d3b59e tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-quobyte-01b831e8-4fda-471e-9c5c-5a6a17295fe5" released by "_delete_snapshot" :: held 2.280s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:35 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a5bb99f5-3cbb-4ae8-bfc9-9518a3d3b59e tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-quobyte-2933749f-c193-42bb-82a4-fc162cad0285" released by "delete_snapshot" :: held 2.295s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:35 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-a5bb99f5-3cbb-4ae8-bfc9-9518a3d3b59e tempest-VolumeDependencyTests-1245527214 None] Created reservations ['354404cb-9752-4740-afd2-7cd140835d18', '295afe0b-2baf-4453-b009-532cf18ee1e1', '822567be-0925-4d00-bdad-7efbfd73f28f', 'd06c9ff5-7e1d-4a39-9a0d-c23febefeb35'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:03:35 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-a5bb99f5-3cbb-4ae8-bfc9-9518a3d3b59e tempest-VolumeDependencyTests-1245527214 None] Delete snapshot completed successfully. Apr 16 23:03:35 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a5bb99f5-3cbb-4ae8-bfc9-9518a3d3b59e tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-01b831e8-4fda-471e-9c5c-5a6a17295fe5-delete_snapshot" released by "delete_snapshot" :: held 2.410s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:35 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-49cfefd1-9c0c-4705-9b40-01f8873f509c tempest-VolumesServicesTestJSON-358380302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2a2703f3-96b7-4856-8806-62a90a179071" returned: 0 in 0.443s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:36 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-49cfefd1-9c0c-4705-9b40-01f8873f509c tempest-VolumesServicesTestJSON-358380302 None] Lock "cinder-quobyte-2a2703f3-96b7-4856-8806-62a90a179071" released by "delete_volume" :: held 0.971s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:36 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-49cfefd1-9c0c-4705-9b40-01f8873f509c tempest-VolumesServicesTestJSON-358380302 None] Created reservations ['746c6a72-8161-41df-804f-74c7802aae22', 'ad9fc19c-726f-4166-b94b-9e4617cf2918', '5708af12-17e9-45da-b7fd-8354858a8aef', '1649d646-42ff-43a2-b944-5baaac029b2d'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:03:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-49cfefd1-9c0c-4705-9b40-01f8873f509c tempest-VolumesServicesTestJSON-358380302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-49cfefd1-9c0c-4705-9b40-01f8873f509c tempest-VolumesServicesTestJSON-358380302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-49cfefd1-9c0c-4705-9b40-01f8873f509c tempest-VolumesServicesTestJSON-358380302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:03:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-49cfefd1-9c0c-4705-9b40-01f8873f509c tempest-VolumesServicesTestJSON-358380302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:03:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-49cfefd1-9c0c-4705-9b40-01f8873f509c tempest-VolumesServicesTestJSON-358380302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-49cfefd1-9c0c-4705-9b40-01f8873f509c tempest-VolumesServicesTestJSON-358380302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:36 devstack sudo[88797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:03:36 devstack sudo[88797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:36 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5f237b44-9349-49d8-87e4-228df8bc8008 tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "cinder-2933749f-c193-42bb-82a4-fc162cad0285-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:36 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5f237b44-9349-49d8-87e4-228df8bc8008 tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-2933749f-c193-42bb-82a4-fc162cad0285-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:36 devstack sudo[88797]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:36 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5f237b44-9349-49d8-87e4-228df8bc8008 tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "cinder-quobyte-2933749f-c193-42bb-82a4-fc162cad0285" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-49cfefd1-9c0c-4705-9b40-01f8873f509c tempest-VolumesServicesTestJSON-358380302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.708s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:36 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-49cfefd1-9c0c-4705-9b40-01f8873f509c tempest-VolumesServicesTestJSON-358380302 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:03:36 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-49cfefd1-9c0c-4705-9b40-01f8873f509c tempest-VolumesServicesTestJSON-358380302 None] Deleted volume successfully. Apr 16 23:03:36 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5f237b44-9349-49d8-87e4-228df8bc8008 tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-quobyte-2933749f-c193-42bb-82a4-fc162cad0285" acquired by "delete_volume" :: waited 0.027s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:36 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-49cfefd1-9c0c-4705-9b40-01f8873f509c tempest-VolumesServicesTestJSON-358380302 None] Lock "cinder-2a2703f3-96b7-4856-8806-62a90a179071-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:36 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cf2fb1-4f31-4746-beae-34042d063ee0]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5f237b44-9349-49d8-87e4-228df8bc8008 tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:36 devstack sudo[88800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285 Apr 16 23:03:36 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:37 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5f237b44-9349-49d8-87e4-228df8bc8008 tempest-VolumeDependencyTests-1245527214 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285" returned: 0 in 0.639s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5f237b44-9349-49d8-87e4-228df8bc8008 tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:37 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285 Apr 16 23:03:37 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:38 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5f237b44-9349-49d8-87e4-228df8bc8008 tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2933749f-c193-42bb-82a4-fc162cad0285" returned: 0 in 0.598s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:38 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5f237b44-9349-49d8-87e4-228df8bc8008 tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-quobyte-2933749f-c193-42bb-82a4-fc162cad0285" released by "delete_volume" :: held 1.277s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:38 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-5f237b44-9349-49d8-87e4-228df8bc8008 tempest-VolumeDependencyTests-1245527214 None] Created reservations ['040935c0-bdfe-45d3-b97c-1242419a5a2f', 'bf61482b-33fc-4d66-8f17-3d0fd01c3afc', '10dbc6c7-2876-42e3-a958-76b44f28f2ea', '604e9907-a21d-4094-9561-dda9a9d25e17'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:03:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5f237b44-9349-49d8-87e4-228df8bc8008 tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5f237b44-9349-49d8-87e4-228df8bc8008 tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:38 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5f237b44-9349-49d8-87e4-228df8bc8008 tempest-VolumeDependencyTests-1245527214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:03:38 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5f237b44-9349-49d8-87e4-228df8bc8008 tempest-VolumeDependencyTests-1245527214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:03:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5f237b44-9349-49d8-87e4-228df8bc8008 tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5f237b44-9349-49d8-87e4-228df8bc8008 tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:38 devstack sudo[88808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:03:38 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:38 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5f237b44-9349-49d8-87e4-228df8bc8008 tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.688s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:38 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-5f237b44-9349-49d8-87e4-228df8bc8008 tempest-VolumeDependencyTests-1245527214 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:03:38 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-5f237b44-9349-49d8-87e4-228df8bc8008 tempest-VolumeDependencyTests-1245527214 None] Deleted volume successfully. Apr 16 23:03:38 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5f237b44-9349-49d8-87e4-228df8bc8008 tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-2933749f-c193-42bb-82a4-fc162cad0285-delete_volume" released by "delete_volume" :: held 2.312s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:39 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:03:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Flow 'volume_create_manager' (d5e94539-2334-4340-b88d-1b2b580a3d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:03:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a0be61-c47a-49c4-9a21-3290e93a48c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4a0be61-c47a-49c4-9a21-3290e93a48c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-70646176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fade8537aa824b2abae98c550d79cade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:03:39Z,use_quota=True,user_id='8cdc660fcb944b6db5560c45c1ed6150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0fc4a05-37a2-4bd6-949d-7eb1c1b0fa65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0fc4a05-37a2-4bd6-949d-7eb1c1b0fa65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07cc544c-30e9-4ef1-a972-1c64aed95e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07cc544c-30e9-4ef1-a972-1c64aed95e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7', 'volume_name': 'volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b609f147-3cc1-457f-8e2d-a7df49fa995c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b609f147-3cc1-457f-8e2d-a7df49fa995c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c02897-a191-4ae0-ad47-934b43655fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:39 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Volume 13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7', 'volume_size': 1} Apr 16 23:03:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:39 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-70646176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fade8537aa824b2abae98c550d79cade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:03:39Z,use_quota=True,user_id='8cdc660fcb944b6db5560c45c1ed6150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:03:39 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Creating volume 13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:03:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:39 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:03:39 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:03:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:39 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:03:39 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:03:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:39 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 1073741824 Apr 16 23:03:39 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:40 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 1073741824" returned: 0 in 0.723s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:40 devstack sudo[88816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 Apr 16 23:03:40 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Flow 'volume_create_manager' (f23e959d-37d2-45d2-a5e9-e107ecae5bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:03:40 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20e80a4-4983-4502-aa9a-5d12fdbb8516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7" returned: 0 in 0.651s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20e80a4-4983-4502-aa9a-5d12fdbb8516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1212643764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ceb2d7-56a2-4812-9e1f-86220045abdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e9b238a81d47f794facbdb3cdc8f54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:03:41Z,use_quota=True,user_id='be7b4bfe27764b429cc1d501f3a15022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad7b7157-a3a6-41af-a5a4-8d48196e7535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad7b7157-a3a6-41af-a5a4-8d48196e7535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12c545a-97e0-4732-ae92-d13e3389024e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12c545a-97e0-4732-ae92-d13e3389024e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3ceb2d7-56a2-4812-9e1f-86220045abdf', 'volume_name': 'volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ecef53-cc5a-48d0-ab75-b44700dbcb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43ecef53-cc5a-48d0-ab75-b44700dbcb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c25d1ce-0751-4ecc-85df-f64eb554eff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:40 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Volume d3ceb2d7-56a2-4812-9e1f-86220045abdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf', 'volume_size': 1} Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1212643764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ceb2d7-56a2-4812-9e1f-86220045abdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e9b238a81d47f794facbdb3cdc8f54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:03:41Z,use_quota=True,user_id='be7b4bfe27764b429cc1d501f3a15022',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Creating volume d3ceb2d7-56a2-4812-9e1f-86220045abdf {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:03:40 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:40 devstack sudo[88819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf 1073741824 Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4c02897-a191-4ae0-ad47-934b43655fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:40 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5877bfbd-a9cd-4ccc-aa3a-4b53c6427110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:40 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Volume volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 (13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7): created successfully Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5877bfbd-a9cd-4ccc-aa3a-4b53c6427110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:40 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Flow 'volume_create_manager' (d5e94539-2334-4340-b88d-1b2b580a3d26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:03:40 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-89455260-6ed0-4982-95c1-226c4f8fc9cb tempest-VolumeDependencyTests-1245527214 None] Created volume successfully. Apr 16 23:03:41 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf 1073741824" returned: 0 in 0.598s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:41 devstack sudo[88824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf Apr 16 23:03:41 devstack sudo[88824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:41 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:03:41 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Flow 'volume_create_manager' (d52e6461-83cc-43a5-b62e-25700a725c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:03:41 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4722e5e5-efdf-4edd-9e28-4425a3691b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:41 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4722e5e5-efdf-4edd-9e28-4425a3691b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-51734227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce20117-1b58-46c4-91b6-650e2ec145a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fade8537aa824b2abae98c550d79cade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7,status='creating',terminated_at=None,updated_at=2026-04-16T21:03:42Z,use_quota=True,user_id='8cdc660fcb944b6db5560c45c1ed6150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:41 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f4e33d-5eef-4d11-bc63-abe58675bff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:41 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f4e33d-5eef-4d11-bc63-abe58675bff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:41 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdfdefc0-4a5d-4924-b300-0d6d99486d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:41 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdfdefc0-4a5d-4924-b300-0d6d99486d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3ce20117-1b58-46c4-91b6-650e2ec145a2', 'volume_name': 'volume-3ce20117-1b58-46c4-91b6-650e2ec145a2', 'volume_size': 1, 'source_volid': '13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7', 'source_volstatus': 'available'}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:41 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3db4ee-2e43-4558-9864-fa5908b26fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:41 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3db4ee-2e43-4558-9864-fa5908b26fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:41 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77477e28-a87f-4af6-a180-a5e2a1b84207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:41 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Volume 3ce20117-1b58-46c4-91b6-650e2ec145a2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3ce20117-1b58-46c4-91b6-650e2ec145a2', 'volume_size': 1, 'source_volid': '13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7', 'source_volstatus': 'available'} Apr 16 23:03:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:41 devstack sudo[88824]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf" returned: 0 in 0.593s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:41 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] <== create_volume: return (1227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:03:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.062s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:42 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Cloning volume 13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 to volume 3ce20117-1b58-46c4-91b6-650e2ec145a2 Apr 16 23:03:42 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c25d1ce-0751-4ecc-85df-f64eb554eff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:42 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4a9adf-0570-4cee-9a25-5a2ecdda8eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:42 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Volume volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf (d3ceb2d7-56a2-4812-9e1f-86220045abdf): created successfully Apr 16 23:03:42 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4a9adf-0570-4cee-9a25-5a2ecdda8eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:42 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Flow 'volume_create_manager' (f23e959d-37d2-45d2-a5e9-e107ecae5bba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:03:42 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Creating offline snapshot f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58 of volume 13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:03:42 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-ca42e31b-b831-4c99-8c98-f1e8bccd5bd1 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Created volume successfully. Apr 16 23:03:42 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c8d83e-a7c7-498f-987a-bddba12ae41c]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:42 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 Apr 16 23:03:42 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:42 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7" returned: 0 in 0.491s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:42 devstack sudo[88833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58 1G Apr 16 23:03:42 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c96651e0-1598-46d7-8c67-b4ebed9a0aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:43 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58 1G" returned: 0 in 0.562s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:43 devstack sudo[88838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58 Apr 16 23:03:43 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:43 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58" returned: 0 in 0.470s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:43 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58 is being set with open permissions: ugo+rw Apr 16 23:03:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:43 devstack sudo[88843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58 Apr 16 23:03:43 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:44 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58" returned: 0 in 0.437s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:44 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.info Apr 16 23:03:44 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:44 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.info" returned: 0 in 0.466s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:44 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.info is being set with open permissions: ugo+rw Apr 16 23:03:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:44 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.info Apr 16 23:03:44 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:44 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.info" returned: 0 in 0.441s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:44 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "cinder-quobyte-3ce20117-1b58-46c4-91b6-650e2ec145a2" by "_copy_volume_from_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:44 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-quobyte-3ce20117-1b58-46c4-91b6-650e2ec145a2" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:44 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] snapshot: f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58, volume: 3ce20117-1b58-46c4-91b6-650e2ec145a2, {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 23:03:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:44 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:03:45 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:03:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:45 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb33706a-95a4-4a05-8b63-2bf321aef9ad]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:45 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58 Apr 16 23:03:45 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:45 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58" returned: 0 in 0.482s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:45 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:03:45 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 23:03:45 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Creating direct copy from snapshot {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 23:03:45 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aeafc2a-6030-4ee6-b1e8-2db60472489b]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:45 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 Apr 16 23:03:45 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:46 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7" returned: 0 in 0.555s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:46 devstack cinder-volume[81971]: DEBUG cinder.utils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Path /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ce20117-1b58-46c4-91b6-650e2ec145a2 not found in is_blk_device check {{(pid=81971) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 23:03:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ce20117-1b58-46c4-91b6-650e2ec145a2 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:46 devstack sudo[88862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ce20117-1b58-46c4-91b6-650e2ec145a2 Apr 16 23:03:46 devstack sudo[88862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:48 devstack sudo[88862]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ce20117-1b58-46c4-91b6-650e2ec145a2" returned: 0 in 2.485s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:48 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[71affcc7-6f18-43a4-ac2d-103a59ebc4cc]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:48 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 Apr 16 23:03:48 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:49 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7" returned: 0 in 0.799s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:49 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Image conversion details: src /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7, size 1024.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ce20117-1b58-46c4-91b6-650e2ec145a2 {{(pid=81971) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 23:03:49 devstack cinder-volume[81971]: INFO cinder.image.image_utils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Converted 1024.00 MB image at 411.69 MB/s Apr 16 23:03:49 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ce20117-1b58-46c4-91b6-650e2ec145a2 is being set with open permissions: ugo+rw Apr 16 23:03:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ce20117-1b58-46c4-91b6-650e2ec145a2 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:49 devstack sudo[88885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ce20117-1b58-46c4-91b6-650e2ec145a2 Apr 16 23:03:49 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:49 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ce20117-1b58-46c4-91b6-650e2ec145a2" returned: 0 in 0.556s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:49 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-quobyte-3ce20117-1b58-46c4-91b6-650e2ec145a2" released by "_copy_volume_from_snapshot" :: held 4.940s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:49 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "cinder-quobyte-f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:49 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-quobyte-f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Deleting offline snapshot f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58 of volume 13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:03:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] snapshot_file for this snap is: volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:03:49 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[479af2ed-ec09-4bf9-9011-5c6c8787fcc1]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:50 devstack sudo[88888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58 Apr 16 23:03:50 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:50 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58" returned: 0 in 0.649s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:50 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:03:50 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb6cf4b-b08f-43ed-bd3e-ffc76c072669]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:50 devstack sudo[88893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 Apr 16 23:03:50 devstack sudo[88893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:51 devstack sudo[88893]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7" returned: 0 in 0.608s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:51 devstack sudo[88898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58 Apr 16 23:03:51 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:51 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58" returned: 0 in 0.637s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:51 devstack sudo[88905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58 Apr 16 23:03:51 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:52 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7.f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58" returned: 0 in 0.626s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:52 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-quobyte-f5ef032a-a3fd-4756-bd4d-8d8e9e9dce58" released by "_delete_snapshot" :: held 2.592s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.580s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c96651e0-1598-46d7-8c67-b4ebed9a0aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.640s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:52 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77477e28-a87f-4af6-a180-a5e2a1b84207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ce20117-1b58-46c4-91b6-650e2ec145a2', 'volume_size': 1, 'source_volid': '13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7', 'source_volstatus': 'available'}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:52 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d012642-3a1c-4fe6-b982-f3679eb49dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:03:52 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-c96651e0-1598-46d7-8c67-b4ebed9a0aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Creating offline snapshot b829091c-8d1e-438f-bda7-36a04bccf1c4 of volume d3ceb2d7-56a2-4812-9e1f-86220045abdf {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:03:52 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Volume volume-3ce20117-1b58-46c4-91b6-650e2ec145a2 (3ce20117-1b58-46c4-91b6-650e2ec145a2): created successfully Apr 16 23:03:52 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d012642-3a1c-4fe6-b982-f3679eb49dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:03:52 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Flow 'volume_create_manager' (d52e6461-83cc-43a5-b62e-25700a725c4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:03:52 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0cca1b-45ad-4f73-89b0-564a833aebf8]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c96651e0-1598-46d7-8c67-b4ebed9a0aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:52 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-2a78d18f-6228-4e58-b5e3-fb7b5fd9ee0f tempest-VolumeDependencyTests-1245527214 None] Created volume successfully. Apr 16 23:03:52 devstack sudo[88909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf Apr 16 23:03:52 devstack sudo[88909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:53 devstack sudo[88909]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c96651e0-1598-46d7-8c67-b4ebed9a0aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf" returned: 0 in 0.639s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c96651e0-1598-46d7-8c67-b4ebed9a0aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.b829091c-8d1e-438f-bda7-36a04bccf1c4 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:53 devstack sudo[88914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.b829091c-8d1e-438f-bda7-36a04bccf1c4 1G Apr 16 23:03:53 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:53 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e6551349-f52a-4e07-9a76-14157ec3e1e2 tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "cinder-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:53 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e6551349-f52a-4e07-9a76-14157ec3e1e2 tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:53 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e6551349-f52a-4e07-9a76-14157ec3e1e2 tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "cinder-quobyte-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:53 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e6551349-f52a-4e07-9a76-14157ec3e1e2 tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-quobyte-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7" acquired by "delete_volume" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:53 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbc6642-bbc7-40bf-83f0-faed44248066]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e6551349-f52a-4e07-9a76-14157ec3e1e2 tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:53 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 Apr 16 23:03:53 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:54 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c96651e0-1598-46d7-8c67-b4ebed9a0aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.b829091c-8d1e-438f-bda7-36a04bccf1c4 1G" returned: 0 in 0.723s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c96651e0-1598-46d7-8c67-b4ebed9a0aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.b829091c-8d1e-438f-bda7-36a04bccf1c4 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:54 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.b829091c-8d1e-438f-bda7-36a04bccf1c4 Apr 16 23:03:54 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:54 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e6551349-f52a-4e07-9a76-14157ec3e1e2 tempest-VolumeDependencyTests-1245527214 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7" returned: 0 in 0.665s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e6551349-f52a-4e07-9a76-14157ec3e1e2 tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:54 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7 Apr 16 23:03:54 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:54 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c96651e0-1598-46d7-8c67-b4ebed9a0aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.b829091c-8d1e-438f-bda7-36a04bccf1c4" returned: 0 in 0.715s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:54 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-c96651e0-1598-46d7-8c67-b4ebed9a0aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.b829091c-8d1e-438f-bda7-36a04bccf1c4 is being set with open permissions: ugo+rw Apr 16 23:03:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c96651e0-1598-46d7-8c67-b4ebed9a0aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.b829091c-8d1e-438f-bda7-36a04bccf1c4 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:54 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.b829091c-8d1e-438f-bda7-36a04bccf1c4 Apr 16 23:03:54 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:55 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e6551349-f52a-4e07-9a76-14157ec3e1e2 tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7" returned: 0 in 0.770s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:55 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e6551349-f52a-4e07-9a76-14157ec3e1e2 tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-quobyte-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7" released by "delete_volume" :: held 1.477s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:55 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-e6551349-f52a-4e07-9a76-14157ec3e1e2 tempest-VolumeDependencyTests-1245527214 None] Created reservations ['614a4c44-6323-4146-8dca-a5aba8b3e583', '8ec6234c-da93-42b9-9b9d-297f307edffb', '8ea0774d-ab08-4229-89a9-abe947f24d66', '5fa20feb-fb89-4ef1-9161-15251704588e'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:03:55 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e6551349-f52a-4e07-9a76-14157ec3e1e2 tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e6551349-f52a-4e07-9a76-14157ec3e1e2 tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:55 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e6551349-f52a-4e07-9a76-14157ec3e1e2 tempest-VolumeDependencyTests-1245527214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:03:55 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e6551349-f52a-4e07-9a76-14157ec3e1e2 tempest-VolumeDependencyTests-1245527214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:03:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e6551349-f52a-4e07-9a76-14157ec3e1e2 tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e6551349-f52a-4e07-9a76-14157ec3e1e2 tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c96651e0-1598-46d7-8c67-b4ebed9a0aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.b829091c-8d1e-438f-bda7-36a04bccf1c4" returned: 0 in 0.663s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:55 devstack sudo[88935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:03:55 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c96651e0-1598-46d7-8c67-b4ebed9a0aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:55 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.info Apr 16 23:03:55 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:55 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c96651e0-1598-46d7-8c67-b4ebed9a0aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.info" returned: 0 in 0.493s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:55 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-c96651e0-1598-46d7-8c67-b4ebed9a0aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.info is being set with open permissions: ugo+rw Apr 16 23:03:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c96651e0-1598-46d7-8c67-b4ebed9a0aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:55 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e6551349-f52a-4e07-9a76-14157ec3e1e2 tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.554s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:55 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-e6551349-f52a-4e07-9a76-14157ec3e1e2 tempest-VolumeDependencyTests-1245527214 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:03:55 devstack sudo[88941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.info Apr 16 23:03:55 devstack sudo[88941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:55 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-e6551349-f52a-4e07-9a76-14157ec3e1e2 tempest-VolumeDependencyTests-1245527214 None] Deleted volume successfully. Apr 16 23:03:55 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-1633def8-0f7d-4758-8937-d465dc241909 tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "cinder-3ce20117-1b58-46c4-91b6-650e2ec145a2-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:55 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-1633def8-0f7d-4758-8937-d465dc241909 tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-3ce20117-1b58-46c4-91b6-650e2ec145a2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:55 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e6551349-f52a-4e07-9a76-14157ec3e1e2 tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-13b2fdc8-3950-4b08-b8d8-2844e2cd9cd7-delete_volume" released by "delete_volume" :: held 2.248s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:56 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-1633def8-0f7d-4758-8937-d465dc241909 tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "cinder-quobyte-3ce20117-1b58-46c4-91b6-650e2ec145a2" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:56 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-1633def8-0f7d-4758-8937-d465dc241909 tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-quobyte-3ce20117-1b58-46c4-91b6-650e2ec145a2" acquired by "delete_volume" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:56 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96de043-7cdb-4efa-ac66-4abf386fc5eb]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1633def8-0f7d-4758-8937-d465dc241909 tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ce20117-1b58-46c4-91b6-650e2ec145a2 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:56 devstack sudo[88943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ce20117-1b58-46c4-91b6-650e2ec145a2 Apr 16 23:03:56 devstack sudo[88943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:56 devstack sudo[88941]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c96651e0-1598-46d7-8c67-b4ebed9a0aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.info" returned: 0 in 0.749s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c96651e0-1598-46d7-8c67-b4ebed9a0aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.093s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:56 devstack sudo[88943]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1633def8-0f7d-4758-8937-d465dc241909 tempest-VolumeDependencyTests-1245527214 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ce20117-1b58-46c4-91b6-650e2ec145a2" returned: 0 in 0.660s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1633def8-0f7d-4758-8937-d465dc241909 tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ce20117-1b58-46c4-91b6-650e2ec145a2 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:56 devstack sudo[88949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ce20117-1b58-46c4-91b6-650e2ec145a2 Apr 16 23:03:56 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:56 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-c96651e0-1598-46d7-8c67-b4ebed9a0aaa tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Create snapshot completed successfully Apr 16 23:03:57 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1633def8-0f7d-4758-8937-d465dc241909 tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ce20117-1b58-46c4-91b6-650e2ec145a2" returned: 0 in 0.574s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:57 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-1633def8-0f7d-4758-8937-d465dc241909 tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-quobyte-3ce20117-1b58-46c4-91b6-650e2ec145a2" released by "delete_volume" :: held 1.268s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:57 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-1633def8-0f7d-4758-8937-d465dc241909 tempest-VolumeDependencyTests-1245527214 None] Created reservations ['dcf0e45e-4dbd-4506-b6dc-42c1938a5069', 'ef291d05-fc1d-4994-a99d-b57e76a29eb5', '2a74ff21-e09f-4e66-a0f1-22df0e1c0122', '4c831cfc-e66d-4288-a411-1d5d6a1ac8c5'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:03:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1633def8-0f7d-4758-8937-d465dc241909 tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1633def8-0f7d-4758-8937-d465dc241909 tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-1633def8-0f7d-4758-8937-d465dc241909 tempest-VolumeDependencyTests-1245527214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:03:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-1633def8-0f7d-4758-8937-d465dc241909 tempest-VolumeDependencyTests-1245527214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:03:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1633def8-0f7d-4758-8937-d465dc241909 tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1633def8-0f7d-4758-8937-d465dc241909 tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:57 devstack sudo[88952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:03:57 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:57 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1633def8-0f7d-4758-8937-d465dc241909 tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.464s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:57 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-1633def8-0f7d-4758-8937-d465dc241909 tempest-VolumeDependencyTests-1245527214 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:03:57 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-1633def8-0f7d-4758-8937-d465dc241909 tempest-VolumeDependencyTests-1245527214 None] Deleted volume successfully. Apr 16 23:03:57 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-1633def8-0f7d-4758-8937-d465dc241909 tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-3ce20117-1b58-46c4-91b6-650e2ec145a2-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:57 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-833e2ddd-cf21-4688-b8f5-1b692b615df6 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Acquiring lock "cinder-b829091c-8d1e-438f-bda7-36a04bccf1c4-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:57 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-833e2ddd-cf21-4688-b8f5-1b692b615df6 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Lock "cinder-b829091c-8d1e-438f-bda7-36a04bccf1c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:57 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-833e2ddd-cf21-4688-b8f5-1b692b615df6 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Acquiring lock "cinder-quobyte-d3ceb2d7-56a2-4812-9e1f-86220045abdf" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:57 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-833e2ddd-cf21-4688-b8f5-1b692b615df6 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Lock "cinder-quobyte-d3ceb2d7-56a2-4812-9e1f-86220045abdf" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:57 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-833e2ddd-cf21-4688-b8f5-1b692b615df6 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Acquiring lock "cinder-quobyte-b829091c-8d1e-438f-bda7-36a04bccf1c4" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:58 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-833e2ddd-cf21-4688-b8f5-1b692b615df6 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Lock "cinder-quobyte-b829091c-8d1e-438f-bda7-36a04bccf1c4" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:58 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-833e2ddd-cf21-4688-b8f5-1b692b615df6 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Deleting offline snapshot b829091c-8d1e-438f-bda7-36a04bccf1c4 of volume d3ceb2d7-56a2-4812-9e1f-86220045abdf {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:03:58 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-833e2ddd-cf21-4688-b8f5-1b692b615df6 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] snapshot_file for this snap is: volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.b829091c-8d1e-438f-bda7-36a04bccf1c4 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:03:58 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a23ec0-41ee-4b1d-b72c-c37365a591ca]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-833e2ddd-cf21-4688-b8f5-1b692b615df6 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.b829091c-8d1e-438f-bda7-36a04bccf1c4 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:58 devstack sudo[88955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.b829091c-8d1e-438f-bda7-36a04bccf1c4 Apr 16 23:03:58 devstack sudo[88955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:58 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4006b179-8265-44d9-bf2c-254105678f7f tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "cinder-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:58 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4006b179-8265-44d9-bf2c-254105678f7f tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:58 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4006b179-8265-44d9-bf2c-254105678f7f tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "cinder-quobyte-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:03:58 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4006b179-8265-44d9-bf2c-254105678f7f tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-quobyte-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836" acquired by "delete_volume" :: waited 0.014s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:03:58 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4559710-a1b0-4b25-a765-57c633ed58a5]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4006b179-8265-44d9-bf2c-254105678f7f tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:58 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836 Apr 16 23:03:58 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:58 devstack sudo[88955]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-833e2ddd-cf21-4688-b8f5-1b692b615df6 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.b829091c-8d1e-438f-bda7-36a04bccf1c4" returned: 0 in 0.610s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:58 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-833e2ddd-cf21-4688-b8f5-1b692b615df6 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:03:58 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[e720cdec-a804-4185-bb33-3b4e394a31ed]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:03:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-833e2ddd-cf21-4688-b8f5-1b692b615df6 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:58 devstack sudo[88962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf Apr 16 23:03:58 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:58 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4006b179-8265-44d9-bf2c-254105678f7f tempest-VolumeDependencyTests-1245527214 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836" returned: 0 in 0.698s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4006b179-8265-44d9-bf2c-254105678f7f tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:59 devstack sudo[88967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836 Apr 16 23:03:59 devstack sudo[88967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:59 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-833e2ddd-cf21-4688-b8f5-1b692b615df6 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf" returned: 0 in 0.629s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-833e2ddd-cf21-4688-b8f5-1b692b615df6 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.b829091c-8d1e-438f-bda7-36a04bccf1c4 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:59 devstack sudo[88984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.b829091c-8d1e-438f-bda7-36a04bccf1c4 Apr 16 23:03:59 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:59 devstack sudo[88967]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4006b179-8265-44d9-bf2c-254105678f7f tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836" returned: 0 in 0.571s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:59 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4006b179-8265-44d9-bf2c-254105678f7f tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-quobyte-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836" released by "delete_volume" :: held 1.300s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:03:59 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-4006b179-8265-44d9-bf2c-254105678f7f tempest-VolumeDependencyTests-1245527214 None] Created reservations ['5b6096a4-ed20-4a42-990e-dbc145608582', 'bb9c8385-db43-4cf8-a9bd-26ee464ef404', 'e6d6630b-74bf-4f58-b218-72db50855c59', 'f452277d-61cb-4d74-a9e6-59426e4091b0'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:03:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-4006b179-8265-44d9-bf2c-254105678f7f tempest-VolumeDependencyTests-1245527214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:03:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-4006b179-8265-44d9-bf2c-254105678f7f tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:03:59 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-4006b179-8265-44d9-bf2c-254105678f7f tempest-VolumeDependencyTests-1245527214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:03:59 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-4006b179-8265-44d9-bf2c-254105678f7f tempest-VolumeDependencyTests-1245527214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:03:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-4006b179-8265-44d9-bf2c-254105678f7f tempest-VolumeDependencyTests-1245527214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:03:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4006b179-8265-44d9-bf2c-254105678f7f tempest-VolumeDependencyTests-1245527214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:59 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:03:59 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:03:59 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root Apr 16 23:03:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-833e2ddd-cf21-4688-b8f5-1b692b615df6 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.b829091c-8d1e-438f-bda7-36a04bccf1c4" returned: 0 in 0.658s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:03:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-833e2ddd-cf21-4688-b8f5-1b692b615df6 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.b829091c-8d1e-438f-bda7-36a04bccf1c4 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:03:59 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.b829091c-8d1e-438f-bda7-36a04bccf1c4 Apr 16 23:03:59 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:00 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4006b179-8265-44d9-bf2c-254105678f7f tempest-VolumeDependencyTests-1245527214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.621s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:00 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-4006b179-8265-44d9-bf2c-254105678f7f tempest-VolumeDependencyTests-1245527214 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:04:00 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-4006b179-8265-44d9-bf2c-254105678f7f tempest-VolumeDependencyTests-1245527214 None] Deleted volume successfully. Apr 16 23:04:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4006b179-8265-44d9-bf2c-254105678f7f tempest-VolumeDependencyTests-1245527214 None] Lock "cinder-38fa7cb4-7ca4-49b4-b9c6-8b23e35ef836-delete_volume" released by "delete_volume" :: held 2.104s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:04:00 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-833e2ddd-cf21-4688-b8f5-1b692b615df6 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf.b829091c-8d1e-438f-bda7-36a04bccf1c4" returned: 0 in 0.569s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-833e2ddd-cf21-4688-b8f5-1b692b615df6 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Lock "cinder-quobyte-b829091c-8d1e-438f-bda7-36a04bccf1c4" released by "_delete_snapshot" :: held 2.558s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:04:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-833e2ddd-cf21-4688-b8f5-1b692b615df6 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Lock "cinder-quobyte-d3ceb2d7-56a2-4812-9e1f-86220045abdf" released by "delete_snapshot" :: held 2.578s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:04:00 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-833e2ddd-cf21-4688-b8f5-1b692b615df6 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Created reservations ['612b1a46-698b-4725-928a-1559880c496a', '03fd9c76-ea94-44cf-b957-e7e42d11859a', '2242a6bd-0e65-4892-92f3-326202b8e7d3', '8a684791-b149-46fe-842c-a62ff4868b09'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:04:00 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-833e2ddd-cf21-4688-b8f5-1b692b615df6 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Delete snapshot completed successfully. Apr 16 23:04:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-833e2ddd-cf21-4688-b8f5-1b692b615df6 tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Lock "cinder-b829091c-8d1e-438f-bda7-36a04bccf1c4-delete_snapshot" released by "delete_snapshot" :: held 2.719s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:04:01 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bfdfd6c2-3a9a-411d-903b-a2eb7f5e817a tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Acquiring lock "cinder-d3ceb2d7-56a2-4812-9e1f-86220045abdf-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:04:01 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bfdfd6c2-3a9a-411d-903b-a2eb7f5e817a tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Lock "cinder-d3ceb2d7-56a2-4812-9e1f-86220045abdf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:04:01 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bfdfd6c2-3a9a-411d-903b-a2eb7f5e817a tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Acquiring lock "cinder-quobyte-d3ceb2d7-56a2-4812-9e1f-86220045abdf" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:04:01 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bfdfd6c2-3a9a-411d-903b-a2eb7f5e817a tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Lock "cinder-quobyte-d3ceb2d7-56a2-4812-9e1f-86220045abdf" acquired by "delete_volume" :: waited 0.009s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:04:01 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1cf978-cd18-46d9-a5d5-a26680339ee0]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:04:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bfdfd6c2-3a9a-411d-903b-a2eb7f5e817a tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:01 devstack sudo[89018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf Apr 16 23:04:01 devstack sudo[89018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:02 devstack sudo[89018]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bfdfd6c2-3a9a-411d-903b-a2eb7f5e817a tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf" returned: 0 in 0.713s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bfdfd6c2-3a9a-411d-903b-a2eb7f5e817a tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:02 devstack sudo[89023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf Apr 16 23:04:02 devstack sudo[89023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:02 devstack sudo[89023]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bfdfd6c2-3a9a-411d-903b-a2eb7f5e817a tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d3ceb2d7-56a2-4812-9e1f-86220045abdf" returned: 0 in 0.576s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bfdfd6c2-3a9a-411d-903b-a2eb7f5e817a tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Lock "cinder-quobyte-d3ceb2d7-56a2-4812-9e1f-86220045abdf" released by "delete_volume" :: held 1.349s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:04:02 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-bfdfd6c2-3a9a-411d-903b-a2eb7f5e817a tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Created reservations ['90c1e634-8ff4-498e-89cf-3492ac55e379', '206d9544-490c-4c1b-8e8f-3ea131964af7', 'db5b674b-1d30-4b18-b9b5-72c50c2c5bb9', '9646f582-f8d7-4336-9213-9aeefb358723'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:04:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bfdfd6c2-3a9a-411d-903b-a2eb7f5e817a tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:04:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bfdfd6c2-3a9a-411d-903b-a2eb7f5e817a tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:04:02 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-bfdfd6c2-3a9a-411d-903b-a2eb7f5e817a tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:04:02 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-bfdfd6c2-3a9a-411d-903b-a2eb7f5e817a tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:04:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bfdfd6c2-3a9a-411d-903b-a2eb7f5e817a tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:04:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bfdfd6c2-3a9a-411d-903b-a2eb7f5e817a tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:02 devstack sudo[89027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:04:02 devstack sudo[89027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:03 devstack sudo[89027]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bfdfd6c2-3a9a-411d-903b-a2eb7f5e817a tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.537s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:03 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-bfdfd6c2-3a9a-411d-903b-a2eb7f5e817a tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:04:03 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-bfdfd6c2-3a9a-411d-903b-a2eb7f5e817a tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Deleted volume successfully. Apr 16 23:04:03 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bfdfd6c2-3a9a-411d-903b-a2eb7f5e817a tempest-VolumeSnapshotQuotasNegativeTestJSON-642494812 None] Lock "cinder-d3ceb2d7-56a2-4812-9e1f-86220045abdf-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:04:04 devstack cinder-volume[81971]: DEBUG oslo_service.periodic_task [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81971) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 23:04:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:04:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:04:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:04:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:04:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:04:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:04 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:04:04 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:05 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.576s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:05 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:04:12 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:SELECT=90,cinder:INSERT=31,cinder:UPDATE=124,cinder:DELETE=12 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 23:04:13 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:SELECT=73,cinder:INSERT=24,cinder:UPDATE=89,cinder:DELETE=6 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 23:04:25 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:04:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Flow 'volume_create_manager' (75b31da2-16f2-4c3b-b35b-d2642494eac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:04:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf40157-3fc9-42af-8a79-767c6dd129b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:04:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cf40157-3fc9-42af-8a79-767c6dd129b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1687874643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770d3912-6fa4-4c17-a9a2-7c3d4df89963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c3e44bc2ac34f75aaa495c311e747d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:04:26Z,use_quota=True,user_id='b7f8662714d942fb8330bc6806b5a86b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:04:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422e5113-605f-4218-8c87-d3af01ffb5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:04:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422e5113-605f-4218-8c87-d3af01ffb5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:04:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef97998-43e0-47a7-b0c8-970f7ba8bb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:04:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef97998-43e0-47a7-b0c8-970f7ba8bb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '770d3912-6fa4-4c17-a9a2-7c3d4df89963', 'volume_name': 'volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:04:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66d0c54-6115-4de6-b9aa-bec4fb5faa01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:04:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e66d0c54-6115-4de6-b9aa-bec4fb5faa01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:04:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff67ced9-35c5-494e-b7fb-6d47bedc3023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:04:25 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Volume 770d3912-6fa4-4c17-a9a2-7c3d4df89963: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963', 'volume_size': 1} Apr 16 23:04:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:04:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:04:25 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1687874643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770d3912-6fa4-4c17-a9a2-7c3d4df89963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c3e44bc2ac34f75aaa495c311e747d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:04:26Z,use_quota=True,user_id='b7f8662714d942fb8330bc6806b5a86b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:04:25 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Creating volume 770d3912-6fa4-4c17-a9a2-7c3d4df89963 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:04:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:04:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:04:25 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:04:25 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:04:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:04:25 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:04:25 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:04:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:25 devstack sudo[89039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963 1073741824 Apr 16 23:04:25 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:26 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963 1073741824" returned: 0 in 0.576s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:26 devstack sudo[89044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963 Apr 16 23:04:26 devstack sudo[89044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:27 devstack sudo[89044]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963" returned: 0 in 0.516s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:27 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:04:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:04:27 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff67ced9-35c5-494e-b7fb-6d47bedc3023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:04:27 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a487dd2c-6e55-463e-9cf2-ec5948a21dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:04:27 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Volume volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963 (770d3912-6fa4-4c17-a9a2-7c3d4df89963): created successfully Apr 16 23:04:27 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a487dd2c-6e55-463e-9cf2-ec5948a21dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:04:27 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Flow 'volume_create_manager' (75b31da2-16f2-4c3b-b35b-d2642494eac8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:04:27 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-2cf3133c-1906-45cd-a3f7-93b3c93436be tempest-SnapshotDependencyTests-1715180604 None] Created volume successfully. Apr 16 23:04:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5b546652-2020-4900-b79f-2f33724e183b tempest-SnapshotDependencyTests-1715180604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:04:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5b546652-2020-4900-b79f-2f33724e183b tempest-SnapshotDependencyTests-1715180604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:04:28 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-5b546652-2020-4900-b79f-2f33724e183b tempest-SnapshotDependencyTests-1715180604 None] Creating offline snapshot 858d679d-d8d2-481c-8537-d0175368f2be of volume 770d3912-6fa4-4c17-a9a2-7c3d4df89963 {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:04:28 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f0eaa6-9687-4513-b665-3e9a1f0da2f4]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:04:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5b546652-2020-4900-b79f-2f33724e183b tempest-SnapshotDependencyTests-1715180604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:28 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963 Apr 16 23:04:28 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:29 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5b546652-2020-4900-b79f-2f33724e183b tempest-SnapshotDependencyTests-1715180604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963" returned: 0 in 0.641s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5b546652-2020-4900-b79f-2f33724e183b tempest-SnapshotDependencyTests-1715180604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.858d679d-d8d2-481c-8537-d0175368f2be 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:29 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.858d679d-d8d2-481c-8537-d0175368f2be 1G Apr 16 23:04:29 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:29 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5b546652-2020-4900-b79f-2f33724e183b tempest-SnapshotDependencyTests-1715180604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.858d679d-d8d2-481c-8537-d0175368f2be 1G" returned: 0 in 0.745s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5b546652-2020-4900-b79f-2f33724e183b tempest-SnapshotDependencyTests-1715180604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.858d679d-d8d2-481c-8537-d0175368f2be {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:29 devstack sudo[89057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.858d679d-d8d2-481c-8537-d0175368f2be Apr 16 23:04:29 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:30 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5b546652-2020-4900-b79f-2f33724e183b tempest-SnapshotDependencyTests-1715180604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.858d679d-d8d2-481c-8537-d0175368f2be" returned: 0 in 0.600s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:30 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-5b546652-2020-4900-b79f-2f33724e183b tempest-SnapshotDependencyTests-1715180604 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.858d679d-d8d2-481c-8537-d0175368f2be is being set with open permissions: ugo+rw Apr 16 23:04:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5b546652-2020-4900-b79f-2f33724e183b tempest-SnapshotDependencyTests-1715180604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.858d679d-d8d2-481c-8537-d0175368f2be {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:30 devstack sudo[89062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.858d679d-d8d2-481c-8537-d0175368f2be Apr 16 23:04:30 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:30 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5b546652-2020-4900-b79f-2f33724e183b tempest-SnapshotDependencyTests-1715180604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.858d679d-d8d2-481c-8537-d0175368f2be" returned: 0 in 0.553s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5b546652-2020-4900-b79f-2f33724e183b tempest-SnapshotDependencyTests-1715180604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:31 devstack sudo[89065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.info Apr 16 23:04:31 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:31 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5b546652-2020-4900-b79f-2f33724e183b tempest-SnapshotDependencyTests-1715180604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.info" returned: 0 in 0.497s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:31 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-5b546652-2020-4900-b79f-2f33724e183b tempest-SnapshotDependencyTests-1715180604 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.info is being set with open permissions: ugo+rw Apr 16 23:04:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5b546652-2020-4900-b79f-2f33724e183b tempest-SnapshotDependencyTests-1715180604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:31 devstack sudo[89068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.info Apr 16 23:04:31 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:32 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5b546652-2020-4900-b79f-2f33724e183b tempest-SnapshotDependencyTests-1715180604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.info" returned: 0 in 0.535s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5b546652-2020-4900-b79f-2f33724e183b tempest-SnapshotDependencyTests-1715180604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.641s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:04:32 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-5b546652-2020-4900-b79f-2f33724e183b tempest-SnapshotDependencyTests-1715180604 None] Create snapshot completed successfully Apr 16 23:04:32 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:04:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Flow 'volume_create_manager' (c496b117-33a1-4858-937d-4728fa333aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:04:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82cfcff9-4e34-430f-8b4f-15fc6f537364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82cfcff9-4e34-430f-8b4f-15fc6f537364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:04:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f35451d-fdcc-4537-b7b9-9054dddf9873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c3e44bc2ac34f75aaa495c311e747d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:04:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=858d679d-d8d2-481c-8537-d0175368f2be,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:04:33Z,use_quota=True,user_id='b7f8662714d942fb8330bc6806b5a86b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72740733-6d7d-44aa-a364-c512c47fc4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72740733-6d7d-44aa-a364-c512c47fc4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d814241b-5ff4-4b9d-a110-8ba361ea95b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d814241b-5ff4-4b9d-a110-8ba361ea95b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2f35451d-fdcc-4537-b7b9-9054dddf9873', 'volume_name': 'volume-2f35451d-fdcc-4537-b7b9-9054dddf9873', 'volume_size': 1, 'snapshot_id': '858d679d-d8d2-481c-8537-d0175368f2be'}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12b3cd8-8feb-466f-84ff-d984ed57c8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12b3cd8-8feb-466f-84ff-d984ed57c8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b1ee88-e1eb-4b71-b491-26ca5f422bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:04:33 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Volume 2f35451d-fdcc-4537-b7b9-9054dddf9873: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2f35451d-fdcc-4537-b7b9-9054dddf9873', 'volume_size': 1, 'snapshot_id': '858d679d-d8d2-481c-8537-d0175368f2be'} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Acquiring lock "cinder-quobyte-858d679d-d8d2-481c-8537-d0175368f2be-2f35451d-fdcc-4537-b7b9-9054dddf9873" by "_create_volume_from_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Lock "cinder-quobyte-858d679d-d8d2-481c-8537-d0175368f2be-2f35451d-fdcc-4537-b7b9-9054dddf9873" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Creating volume 2f35451d-fdcc-4537-b7b9-9054dddf9873 from snapshot 858d679d-d8d2-481c-8537-d0175368f2be {{(pid=81971) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Acquiring lock "cinder-quobyte-2f35451d-fdcc-4537-b7b9-9054dddf9873" by "_copy_volume_from_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Lock "cinder-quobyte-2f35451d-fdcc-4537-b7b9-9054dddf9873" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] snapshot: 858d679d-d8d2-481c-8537-d0175368f2be, volume: 2f35451d-fdcc-4537-b7b9-9054dddf9873, {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[59eaba65-f7ed-4b89-9116-c317d3f114c7]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.858d679d-d8d2-481c-8537-d0175368f2be {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:33 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.858d679d-d8d2-481c-8537-d0175368f2be Apr 16 23:04:33 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:33 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.858d679d-d8d2-481c-8537-d0175368f2be" returned: 0 in 0.563s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963 {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Creating direct copy from snapshot {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[906e2b86-772c-4bcc-91a2-6fa604e72bb4]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:04:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:33 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963 Apr 16 23:04:33 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:34 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963" returned: 0 in 0.608s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:34 devstack cinder-volume[81971]: DEBUG cinder.utils [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Path /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f35451d-fdcc-4537-b7b9-9054dddf9873 not found in is_blk_device check {{(pid=81971) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 23:04:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f35451d-fdcc-4537-b7b9-9054dddf9873 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:34 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f35451d-fdcc-4537-b7b9-9054dddf9873 Apr 16 23:04:34 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:36 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f35451d-fdcc-4537-b7b9-9054dddf9873" returned: 0 in 2.406s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:36 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce1cc7f-36a4-4b28-b3c2-f4108f1fdd00]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:04:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:36 devstack sudo[89098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963 Apr 16 23:04:36 devstack sudo[89098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:37 devstack sudo[89098]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963" returned: 0 in 0.619s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:37 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Image conversion details: src /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963, size 1024.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f35451d-fdcc-4537-b7b9-9054dddf9873 {{(pid=81971) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 23:04:37 devstack cinder-volume[81971]: INFO cinder.image.image_utils [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Converted 1024.00 MB image at 425.27 MB/s Apr 16 23:04:37 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f35451d-fdcc-4537-b7b9-9054dddf9873 is being set with open permissions: ugo+rw Apr 16 23:04:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f35451d-fdcc-4537-b7b9-9054dddf9873 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:37 devstack sudo[89103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f35451d-fdcc-4537-b7b9-9054dddf9873 Apr 16 23:04:37 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:37 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f35451d-fdcc-4537-b7b9-9054dddf9873" returned: 0 in 0.403s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:37 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Lock "cinder-quobyte-2f35451d-fdcc-4537-b7b9-9054dddf9873" released by "_copy_volume_from_snapshot" :: held 4.682s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:04:37 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Lock "cinder-quobyte-858d679d-d8d2-481c-8537-d0175368f2be-2f35451d-fdcc-4537-b7b9-9054dddf9873" released by "_create_volume_from_snapshot" :: held 4.700s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:04:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.708s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:04:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0b1ee88-e1eb-4b71-b491-26ca5f422bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f35451d-fdcc-4537-b7b9-9054dddf9873', 'volume_size': 1, 'snapshot_id': '858d679d-d8d2-481c-8537-d0175368f2be'}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:04:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8217568e-592a-43e1-ae52-606f365e978a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:04:37 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Volume volume-2f35451d-fdcc-4537-b7b9-9054dddf9873 (2f35451d-fdcc-4537-b7b9-9054dddf9873): created successfully Apr 16 23:04:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8217568e-592a-43e1-ae52-606f365e978a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:04:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Flow 'volume_create_manager' (c496b117-33a1-4858-937d-4728fa333aef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:04:37 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-21f4580b-0012-4eaf-a746-9892bd937198 tempest-SnapshotDependencyTests-1715180604 None] Created volume successfully. Apr 16 23:04:38 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b761bbb2-550a-4c7b-9734-d95bb23cddab tempest-SnapshotDependencyTests-1715180604 None] Acquiring lock "cinder-858d679d-d8d2-481c-8537-d0175368f2be-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:04:38 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b761bbb2-550a-4c7b-9734-d95bb23cddab tempest-SnapshotDependencyTests-1715180604 None] Lock "cinder-858d679d-d8d2-481c-8537-d0175368f2be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:04:38 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b761bbb2-550a-4c7b-9734-d95bb23cddab tempest-SnapshotDependencyTests-1715180604 None] Acquiring lock "cinder-quobyte-770d3912-6fa4-4c17-a9a2-7c3d4df89963" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:04:38 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b761bbb2-550a-4c7b-9734-d95bb23cddab tempest-SnapshotDependencyTests-1715180604 None] Lock "cinder-quobyte-770d3912-6fa4-4c17-a9a2-7c3d4df89963" acquired by "delete_snapshot" :: waited 0.006s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:04:38 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b761bbb2-550a-4c7b-9734-d95bb23cddab tempest-SnapshotDependencyTests-1715180604 None] Acquiring lock "cinder-quobyte-858d679d-d8d2-481c-8537-d0175368f2be" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:04:38 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b761bbb2-550a-4c7b-9734-d95bb23cddab tempest-SnapshotDependencyTests-1715180604 None] Lock "cinder-quobyte-858d679d-d8d2-481c-8537-d0175368f2be" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:04:38 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-b761bbb2-550a-4c7b-9734-d95bb23cddab tempest-SnapshotDependencyTests-1715180604 None] Deleting offline snapshot 858d679d-d8d2-481c-8537-d0175368f2be of volume 770d3912-6fa4-4c17-a9a2-7c3d4df89963 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:04:38 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-b761bbb2-550a-4c7b-9734-d95bb23cddab tempest-SnapshotDependencyTests-1715180604 None] snapshot_file for this snap is: volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.858d679d-d8d2-481c-8537-d0175368f2be {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:04:38 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07055fc-e60b-4be4-a91a-0dc7c8b608fc]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:04:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b761bbb2-550a-4c7b-9734-d95bb23cddab tempest-SnapshotDependencyTests-1715180604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.858d679d-d8d2-481c-8537-d0175368f2be {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:38 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.858d679d-d8d2-481c-8537-d0175368f2be Apr 16 23:04:38 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:38 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b761bbb2-550a-4c7b-9734-d95bb23cddab tempest-SnapshotDependencyTests-1715180604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.858d679d-d8d2-481c-8537-d0175368f2be" returned: 0 in 0.485s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:38 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-b761bbb2-550a-4c7b-9734-d95bb23cddab tempest-SnapshotDependencyTests-1715180604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:04:38 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa73886-8e95-4d4d-9e60-ba20dab64179]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:04:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b761bbb2-550a-4c7b-9734-d95bb23cddab tempest-SnapshotDependencyTests-1715180604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:39 devstack sudo[89111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963 Apr 16 23:04:39 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:39 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b761bbb2-550a-4c7b-9734-d95bb23cddab tempest-SnapshotDependencyTests-1715180604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963" returned: 0 in 0.499s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b761bbb2-550a-4c7b-9734-d95bb23cddab tempest-SnapshotDependencyTests-1715180604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.858d679d-d8d2-481c-8537-d0175368f2be {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:39 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.858d679d-d8d2-481c-8537-d0175368f2be Apr 16 23:04:39 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:40 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b761bbb2-550a-4c7b-9734-d95bb23cddab tempest-SnapshotDependencyTests-1715180604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.858d679d-d8d2-481c-8537-d0175368f2be" returned: 0 in 0.510s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b761bbb2-550a-4c7b-9734-d95bb23cddab tempest-SnapshotDependencyTests-1715180604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.858d679d-d8d2-481c-8537-d0175368f2be {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:40 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.858d679d-d8d2-481c-8537-d0175368f2be Apr 16 23:04:40 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:40 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b761bbb2-550a-4c7b-9734-d95bb23cddab tempest-SnapshotDependencyTests-1715180604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963.858d679d-d8d2-481c-8537-d0175368f2be" returned: 0 in 0.520s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:40 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b761bbb2-550a-4c7b-9734-d95bb23cddab tempest-SnapshotDependencyTests-1715180604 None] Lock "cinder-quobyte-858d679d-d8d2-481c-8537-d0175368f2be" released by "_delete_snapshot" :: held 2.077s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:04:40 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b761bbb2-550a-4c7b-9734-d95bb23cddab tempest-SnapshotDependencyTests-1715180604 None] Lock "cinder-quobyte-770d3912-6fa4-4c17-a9a2-7c3d4df89963" released by "delete_snapshot" :: held 2.098s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:04:40 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-b761bbb2-550a-4c7b-9734-d95bb23cddab tempest-SnapshotDependencyTests-1715180604 None] Created reservations ['403b3903-5383-45f7-9d3b-41a4d73333b7', '6b247895-8894-477b-babd-16ee5a37b2d0', 'c9af505d-d58e-4e42-b23a-97cf8e70525f', 'a686b722-9670-4758-8a01-3211e1407d06'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:04:40 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-b761bbb2-550a-4c7b-9734-d95bb23cddab tempest-SnapshotDependencyTests-1715180604 None] Delete snapshot completed successfully. Apr 16 23:04:40 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b761bbb2-550a-4c7b-9734-d95bb23cddab tempest-SnapshotDependencyTests-1715180604 None] Lock "cinder-858d679d-d8d2-481c-8537-d0175368f2be-delete_snapshot" released by "delete_snapshot" :: held 2.219s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:04:41 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-acd46dec-d524-477e-b9ce-e29c3632d682 tempest-SnapshotDependencyTests-1715180604 None] Acquiring lock "cinder-770d3912-6fa4-4c17-a9a2-7c3d4df89963-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:04:41 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-acd46dec-d524-477e-b9ce-e29c3632d682 tempest-SnapshotDependencyTests-1715180604 None] Lock "cinder-770d3912-6fa4-4c17-a9a2-7c3d4df89963-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:04:41 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-acd46dec-d524-477e-b9ce-e29c3632d682 tempest-SnapshotDependencyTests-1715180604 None] Acquiring lock "cinder-quobyte-770d3912-6fa4-4c17-a9a2-7c3d4df89963" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:04:41 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-acd46dec-d524-477e-b9ce-e29c3632d682 tempest-SnapshotDependencyTests-1715180604 None] Lock "cinder-quobyte-770d3912-6fa4-4c17-a9a2-7c3d4df89963" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:04:41 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fc69eb-d08d-47b5-8810-1d38a53c1a22]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:04:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-acd46dec-d524-477e-b9ce-e29c3632d682 tempest-SnapshotDependencyTests-1715180604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:41 devstack sudo[89125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963 Apr 16 23:04:41 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:42 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-acd46dec-d524-477e-b9ce-e29c3632d682 tempest-SnapshotDependencyTests-1715180604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963" returned: 0 in 0.663s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-acd46dec-d524-477e-b9ce-e29c3632d682 tempest-SnapshotDependencyTests-1715180604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:42 devstack sudo[89144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963 Apr 16 23:04:42 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:42 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-acd46dec-d524-477e-b9ce-e29c3632d682 tempest-SnapshotDependencyTests-1715180604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-770d3912-6fa4-4c17-a9a2-7c3d4df89963" returned: 0 in 0.515s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:42 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-acd46dec-d524-477e-b9ce-e29c3632d682 tempest-SnapshotDependencyTests-1715180604 None] Lock "cinder-quobyte-770d3912-6fa4-4c17-a9a2-7c3d4df89963" released by "delete_volume" :: held 1.231s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:04:42 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-acd46dec-d524-477e-b9ce-e29c3632d682 tempest-SnapshotDependencyTests-1715180604 None] Created reservations ['b09afab8-61ae-490d-92f7-52a184aa2a72', 'd4701fad-a867-43e0-94c6-82b207af09fe', '88bfa260-fba9-4f6a-8e33-85655a5b1455', '813de8a5-10dd-4585-bc07-ae2d9295bbea'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:04:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-acd46dec-d524-477e-b9ce-e29c3632d682 tempest-SnapshotDependencyTests-1715180604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:04:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-acd46dec-d524-477e-b9ce-e29c3632d682 tempest-SnapshotDependencyTests-1715180604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:04:43 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-acd46dec-d524-477e-b9ce-e29c3632d682 tempest-SnapshotDependencyTests-1715180604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:04:43 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-acd46dec-d524-477e-b9ce-e29c3632d682 tempest-SnapshotDependencyTests-1715180604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:04:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-acd46dec-d524-477e-b9ce-e29c3632d682 tempest-SnapshotDependencyTests-1715180604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:04:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-acd46dec-d524-477e-b9ce-e29c3632d682 tempest-SnapshotDependencyTests-1715180604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:43 devstack sudo[89149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:04:43 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:43 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-acd46dec-d524-477e-b9ce-e29c3632d682 tempest-SnapshotDependencyTests-1715180604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.686s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:43 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-acd46dec-d524-477e-b9ce-e29c3632d682 tempest-SnapshotDependencyTests-1715180604 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:04:43 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-acd46dec-d524-477e-b9ce-e29c3632d682 tempest-SnapshotDependencyTests-1715180604 None] Deleted volume successfully. Apr 16 23:04:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-acd46dec-d524-477e-b9ce-e29c3632d682 tempest-SnapshotDependencyTests-1715180604 None] Lock "cinder-770d3912-6fa4-4c17-a9a2-7c3d4df89963-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:04:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8dfec879-2d6d-40ae-9b0f-4d548eefeba5 tempest-SnapshotDependencyTests-1715180604 None] Acquiring lock "cinder-2f35451d-fdcc-4537-b7b9-9054dddf9873-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:04:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8dfec879-2d6d-40ae-9b0f-4d548eefeba5 tempest-SnapshotDependencyTests-1715180604 None] Lock "cinder-2f35451d-fdcc-4537-b7b9-9054dddf9873-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:04:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8dfec879-2d6d-40ae-9b0f-4d548eefeba5 tempest-SnapshotDependencyTests-1715180604 None] Acquiring lock "cinder-quobyte-2f35451d-fdcc-4537-b7b9-9054dddf9873" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:04:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8dfec879-2d6d-40ae-9b0f-4d548eefeba5 tempest-SnapshotDependencyTests-1715180604 None] Lock "cinder-quobyte-2f35451d-fdcc-4537-b7b9-9054dddf9873" acquired by "delete_volume" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:04:43 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b5aa49-ff43-45a6-b52b-57f9c255af93]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:04:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8dfec879-2d6d-40ae-9b0f-4d548eefeba5 tempest-SnapshotDependencyTests-1715180604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f35451d-fdcc-4537-b7b9-9054dddf9873 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:44 devstack sudo[89152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f35451d-fdcc-4537-b7b9-9054dddf9873 Apr 16 23:04:44 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:44 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8dfec879-2d6d-40ae-9b0f-4d548eefeba5 tempest-SnapshotDependencyTests-1715180604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f35451d-fdcc-4537-b7b9-9054dddf9873" returned: 0 in 0.674s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8dfec879-2d6d-40ae-9b0f-4d548eefeba5 tempest-SnapshotDependencyTests-1715180604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f35451d-fdcc-4537-b7b9-9054dddf9873 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:44 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f35451d-fdcc-4537-b7b9-9054dddf9873 Apr 16 23:04:44 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:45 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8dfec879-2d6d-40ae-9b0f-4d548eefeba5 tempest-SnapshotDependencyTests-1715180604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-2f35451d-fdcc-4537-b7b9-9054dddf9873" returned: 0 in 0.535s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8dfec879-2d6d-40ae-9b0f-4d548eefeba5 tempest-SnapshotDependencyTests-1715180604 None] Lock "cinder-quobyte-2f35451d-fdcc-4537-b7b9-9054dddf9873" released by "delete_volume" :: held 1.243s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:04:45 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-8dfec879-2d6d-40ae-9b0f-4d548eefeba5 tempest-SnapshotDependencyTests-1715180604 None] Created reservations ['1d784c7c-a99c-4860-97c6-06b26ff7042d', 'd4b71366-24b8-4887-8307-c977004d22fe', '31612c70-f257-4796-acea-c23a6e88cf44', '7b1b92f1-d013-43ec-8bd1-62e2ca59f6c3'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:04:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8dfec879-2d6d-40ae-9b0f-4d548eefeba5 tempest-SnapshotDependencyTests-1715180604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:04:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8dfec879-2d6d-40ae-9b0f-4d548eefeba5 tempest-SnapshotDependencyTests-1715180604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:04:45 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-8dfec879-2d6d-40ae-9b0f-4d548eefeba5 tempest-SnapshotDependencyTests-1715180604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:04:45 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-8dfec879-2d6d-40ae-9b0f-4d548eefeba5 tempest-SnapshotDependencyTests-1715180604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:04:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8dfec879-2d6d-40ae-9b0f-4d548eefeba5 tempest-SnapshotDependencyTests-1715180604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:04:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8dfec879-2d6d-40ae-9b0f-4d548eefeba5 tempest-SnapshotDependencyTests-1715180604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:45 devstack sudo[89163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:04:45 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:45 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8dfec879-2d6d-40ae-9b0f-4d548eefeba5 tempest-SnapshotDependencyTests-1715180604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.514s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:45 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-8dfec879-2d6d-40ae-9b0f-4d548eefeba5 tempest-SnapshotDependencyTests-1715180604 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:04:45 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-8dfec879-2d6d-40ae-9b0f-4d548eefeba5 tempest-SnapshotDependencyTests-1715180604 None] Deleted volume successfully. Apr 16 23:04:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8dfec879-2d6d-40ae-9b0f-4d548eefeba5 tempest-SnapshotDependencyTests-1715180604 None] Lock "cinder-2f35451d-fdcc-4537-b7b9-9054dddf9873-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:04:49 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:04:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Flow 'volume_create_manager' (2e888429-4476-4dca-be5c-02467a3649a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:04:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f6b9b8-172a-4686-a805-acfb30861a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:04:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6f6b9b8-172a-4686-a805-acfb30861a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-109986333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4976c69f-2e5b-4495-aaf2-06cb9718672b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f0e71b7e0f4bdc897cb989e63c9bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:04:49Z,use_quota=True,user_id='f6a6277311214b63a305d3334cff4abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:04:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223dbf09-8b75-46f5-91fc-643eac92fa1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:04:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223dbf09-8b75-46f5-91fc-643eac92fa1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:04:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d8a033b-453d-48d3-a70e-7f00bcb59304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:04:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d8a033b-453d-48d3-a70e-7f00bcb59304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4976c69f-2e5b-4495-aaf2-06cb9718672b', 'volume_name': 'volume-4976c69f-2e5b-4495-aaf2-06cb9718672b', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:04:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1c2c07-acaf-4312-bd39-46d32bb7ffd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:04:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1c2c07-acaf-4312-bd39-46d32bb7ffd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:04:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3aeae1-d9d0-434d-872d-943e0c909704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:04:49 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Volume 4976c69f-2e5b-4495-aaf2-06cb9718672b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4976c69f-2e5b-4495-aaf2-06cb9718672b', 'volume_size': 1} Apr 16 23:04:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:04:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:04:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-109986333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4976c69f-2e5b-4495-aaf2-06cb9718672b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f0e71b7e0f4bdc897cb989e63c9bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:04:49Z,use_quota=True,user_id='f6a6277311214b63a305d3334cff4abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:04:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Creating volume 4976c69f-2e5b-4495-aaf2-06cb9718672b {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:04:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:04:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:04:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:04:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:04:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:04:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:04:49 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:04:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4976c69f-2e5b-4495-aaf2-06cb9718672b 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:49 devstack sudo[89201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4976c69f-2e5b-4495-aaf2-06cb9718672b 1073741824 Apr 16 23:04:49 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:50 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4976c69f-2e5b-4495-aaf2-06cb9718672b 1073741824" returned: 0 in 0.962s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4976c69f-2e5b-4495-aaf2-06cb9718672b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:50 devstack sudo[89207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4976c69f-2e5b-4495-aaf2-06cb9718672b Apr 16 23:04:50 devstack sudo[89207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:50 devstack sudo[89207]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4976c69f-2e5b-4495-aaf2-06cb9718672b" returned: 0 in 0.676s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:50 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:04:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:04:50 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3aeae1-d9d0-434d-872d-943e0c909704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4976c69f-2e5b-4495-aaf2-06cb9718672b', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:04:50 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86117a25-9c6d-492d-aee0-cb264082bfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:04:50 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Volume volume-4976c69f-2e5b-4495-aaf2-06cb9718672b (4976c69f-2e5b-4495-aaf2-06cb9718672b): created successfully Apr 16 23:04:50 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86117a25-9c6d-492d-aee0-cb264082bfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:04:50 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Flow 'volume_create_manager' (2e888429-4476-4dca-be5c-02467a3649a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:04:50 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-83923daf-2d9a-459b-b175-f368e7beed65 tempest-VolumesActionsTest-1059813548 None] Created volume successfully. Apr 16 23:04:51 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-0895e8e1-36a3-43c0-91b7-7060ab56afb5 tempest-VolumesActionsTest-1059813548 None] Acquiring lock "cinder-4976c69f-2e5b-4495-aaf2-06cb9718672b" by "attach_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:04:51 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-0895e8e1-36a3-43c0-91b7-7060ab56afb5 tempest-VolumesActionsTest-1059813548 None] Lock "cinder-4976c69f-2e5b-4495-aaf2-06cb9718672b" acquired by "attach_volume" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:04:51 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-0895e8e1-36a3-43c0-91b7-7060ab56afb5 tempest-VolumesActionsTest-1059813548 None] Attaching volume 4976c69f-2e5b-4495-aaf2-06cb9718672b to instance ad7e5cc5-23dc-4e3f-82c4-726b67533b34 at mountpoint /dev/vdb on host None. Apr 16 23:04:51 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-0895e8e1-36a3-43c0-91b7-7060ab56afb5 tempest-VolumesActionsTest-1059813548 None] Attach volume completed successfully. Apr 16 23:04:51 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-0895e8e1-36a3-43c0-91b7-7060ab56afb5 tempest-VolumesActionsTest-1059813548 None] Lock "cinder-4976c69f-2e5b-4495-aaf2-06cb9718672b" released by "attach_volume" :: held 0.089s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:04:52 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-4c10fc27-c632-49f8-9299-032d245e528d tempest-VolumesActionsTest-84696 None] Terminate volume connection completed successfully. Apr 16 23:04:52 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4c10fc27-c632-49f8-9299-032d245e528d tempest-VolumesActionsTest-84696 None] Acquiring lock "cinder-4976c69f-2e5b-4495-aaf2-06cb9718672b-detach_volume" by "detach_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:04:52 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4c10fc27-c632-49f8-9299-032d245e528d tempest-VolumesActionsTest-84696 None] Lock "cinder-4976c69f-2e5b-4495-aaf2-06cb9718672b-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:04:52 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-4c10fc27-c632-49f8-9299-032d245e528d tempest-VolumesActionsTest-84696 None] Detaching volume 4976c69f-2e5b-4495-aaf2-06cb9718672b from instance ad7e5cc5-23dc-4e3f-82c4-726b67533b34. Apr 16 23:04:52 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-4c10fc27-c632-49f8-9299-032d245e528d tempest-VolumesActionsTest-84696 None] Detach volume completed successfully. Apr 16 23:04:52 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4c10fc27-c632-49f8-9299-032d245e528d tempest-VolumesActionsTest-84696 None] Lock "cinder-4976c69f-2e5b-4495-aaf2-06cb9718672b-detach_volume" released by "detach_volume" :: held 0.067s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:04:53 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-2b6f7c78-2c71-4570-8203-64a693f3dbd1 tempest-VolumesActionsTest-1059813548 None] Acquiring lock "cinder-4976c69f-2e5b-4495-aaf2-06cb9718672b-detach_volume" by "detach_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:04:53 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-2b6f7c78-2c71-4570-8203-64a693f3dbd1 tempest-VolumesActionsTest-1059813548 None] Lock "cinder-4976c69f-2e5b-4495-aaf2-06cb9718672b-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:04:53 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-2b6f7c78-2c71-4570-8203-64a693f3dbd1 tempest-VolumesActionsTest-1059813548 None] Volume detach called, but volume not attached. Apr 16 23:04:53 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-2b6f7c78-2c71-4570-8203-64a693f3dbd1 tempest-VolumesActionsTest-1059813548 None] Lock "cinder-4976c69f-2e5b-4495-aaf2-06cb9718672b-detach_volume" released by "detach_volume" :: held 0.013s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:04:54 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f487d9c3-7526-4f6c-9bdc-7cc95ff89f16 tempest-VolumesActionsTest-1059813548 None] Acquiring lock "cinder-4976c69f-2e5b-4495-aaf2-06cb9718672b-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:04:54 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f487d9c3-7526-4f6c-9bdc-7cc95ff89f16 tempest-VolumesActionsTest-1059813548 None] Lock "cinder-4976c69f-2e5b-4495-aaf2-06cb9718672b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:04:54 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f487d9c3-7526-4f6c-9bdc-7cc95ff89f16 tempest-VolumesActionsTest-1059813548 None] Acquiring lock "cinder-quobyte-4976c69f-2e5b-4495-aaf2-06cb9718672b" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:04:54 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f487d9c3-7526-4f6c-9bdc-7cc95ff89f16 tempest-VolumesActionsTest-1059813548 None] Lock "cinder-quobyte-4976c69f-2e5b-4495-aaf2-06cb9718672b" acquired by "delete_volume" :: waited 0.007s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:04:54 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d11e0c-4472-44fe-8ea8-9fb7142b138c]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:04:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f487d9c3-7526-4f6c-9bdc-7cc95ff89f16 tempest-VolumesActionsTest-1059813548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4976c69f-2e5b-4495-aaf2-06cb9718672b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:54 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4976c69f-2e5b-4495-aaf2-06cb9718672b Apr 16 23:04:54 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:54 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f487d9c3-7526-4f6c-9bdc-7cc95ff89f16 tempest-VolumesActionsTest-1059813548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4976c69f-2e5b-4495-aaf2-06cb9718672b" returned: 0 in 0.581s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f487d9c3-7526-4f6c-9bdc-7cc95ff89f16 tempest-VolumesActionsTest-1059813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4976c69f-2e5b-4495-aaf2-06cb9718672b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:54 devstack sudo[89220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4976c69f-2e5b-4495-aaf2-06cb9718672b Apr 16 23:04:54 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:55 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f487d9c3-7526-4f6c-9bdc-7cc95ff89f16 tempest-VolumesActionsTest-1059813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-4976c69f-2e5b-4495-aaf2-06cb9718672b" returned: 0 in 0.564s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:55 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f487d9c3-7526-4f6c-9bdc-7cc95ff89f16 tempest-VolumesActionsTest-1059813548 None] Lock "cinder-quobyte-4976c69f-2e5b-4495-aaf2-06cb9718672b" released by "delete_volume" :: held 1.174s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:04:55 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-f487d9c3-7526-4f6c-9bdc-7cc95ff89f16 tempest-VolumesActionsTest-1059813548 None] Created reservations ['0bc1a984-ab9a-4508-9e60-36e1c2fc1f47', '47a3401e-83d6-496e-9f56-869e7b563d77', '72fcb754-d5dd-4708-a43c-f26566c64774', '09644ce2-9b89-4a70-bf17-bdefb62298cb'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:04:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f487d9c3-7526-4f6c-9bdc-7cc95ff89f16 tempest-VolumesActionsTest-1059813548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:04:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f487d9c3-7526-4f6c-9bdc-7cc95ff89f16 tempest-VolumesActionsTest-1059813548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:04:55 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-f487d9c3-7526-4f6c-9bdc-7cc95ff89f16 tempest-VolumesActionsTest-1059813548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:04:55 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-f487d9c3-7526-4f6c-9bdc-7cc95ff89f16 tempest-VolumesActionsTest-1059813548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:04:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f487d9c3-7526-4f6c-9bdc-7cc95ff89f16 tempest-VolumesActionsTest-1059813548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:04:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f487d9c3-7526-4f6c-9bdc-7cc95ff89f16 tempest-VolumesActionsTest-1059813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:04:55 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:04:55 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:04:55 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Apr 16 23:04:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f487d9c3-7526-4f6c-9bdc-7cc95ff89f16 tempest-VolumesActionsTest-1059813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.518s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:04:55 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-f487d9c3-7526-4f6c-9bdc-7cc95ff89f16 tempest-VolumesActionsTest-1059813548 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:04:55 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-f487d9c3-7526-4f6c-9bdc-7cc95ff89f16 tempest-VolumesActionsTest-1059813548 None] Deleted volume successfully. Apr 16 23:04:55 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f487d9c3-7526-4f6c-9bdc-7cc95ff89f16 tempest-VolumesActionsTest-1059813548 None] Lock "cinder-4976c69f-2e5b-4495-aaf2-06cb9718672b-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Flow 'volume_create_manager' (0ecb3118-ce3e-4aee-bc38-121e30593c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e92c4b0-5777-4d75-833c-b19239f53095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e92c4b0-5777-4d75-833c-b19239f53095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-835180892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=067d1438-253e-4bf1-b732-0b6a84f2b093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f0e71b7e0f4bdc897cb989e63c9bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:05:04Z,use_quota=True,user_id='f6a6277311214b63a305d3334cff4abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47977280-c286-49b1-a8e5-92af7dfd2094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47977280-c286-49b1-a8e5-92af7dfd2094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b4cc987-0311-4764-b15f-acd51e6b5277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b4cc987-0311-4764-b15f-acd51e6b5277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '067d1438-253e-4bf1-b732-0b6a84f2b093', 'volume_name': 'volume-067d1438-253e-4bf1-b732-0b6a84f2b093', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ea0685-49a4-4533-8a67-927c43858c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ea0685-49a4-4533-8a67-927c43858c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (782bf159-063a-4c47-9a05-dfca0dbd61b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:04 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Volume 067d1438-253e-4bf1-b732-0b6a84f2b093: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-067d1438-253e-4bf1-b732-0b6a84f2b093', 'volume_size': 1} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-835180892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=067d1438-253e-4bf1-b732-0b6a84f2b093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f0e71b7e0f4bdc897cb989e63c9bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:05:04Z,use_quota=True,user_id='f6a6277311214b63a305d3334cff4abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Creating volume 067d1438-253e-4bf1-b732-0b6a84f2b093 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:05:04 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-067d1438-253e-4bf1-b732-0b6a84f2b093 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:04 devstack sudo[89291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-067d1438-253e-4bf1-b732-0b6a84f2b093 1073741824 Apr 16 23:05:04 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG oslo_service.periodic_task [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81971) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:04 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-067d1438-253e-4bf1-b732-0b6a84f2b093 1073741824" returned: 0 in 0.653s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:04 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:05:04 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-067d1438-253e-4bf1-b732-0b6a84f2b093 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:04 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-067d1438-253e-4bf1-b732-0b6a84f2b093 Apr 16 23:05:04 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:05 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.550s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:05 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:05:05 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-067d1438-253e-4bf1-b732-0b6a84f2b093" returned: 0 in 0.531s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:05 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:05:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:05:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (782bf159-063a-4c47-9a05-dfca0dbd61b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-067d1438-253e-4bf1-b732-0b6a84f2b093', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed850460-f740-49f4-ab3e-f1ce7f592b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:05 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Volume volume-067d1438-253e-4bf1-b732-0b6a84f2b093 (067d1438-253e-4bf1-b732-0b6a84f2b093): created successfully Apr 16 23:05:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed850460-f740-49f4-ab3e-f1ce7f592b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Flow 'volume_create_manager' (0ecb3118-ce3e-4aee-bc38-121e30593c6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:05:05 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-c3e067ee-ca93-468b-a5ec-64e021aa8b4d tempest-VolumesActionsTest-1059813548 None] Created volume successfully. Apr 16 23:05:06 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e1752dbe-70b7-4449-a8ae-6a0dfcb3e114 tempest-VolumesActionsTest-84696 None] Acquiring lock "cinder-067d1438-253e-4bf1-b732-0b6a84f2b093-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:05:06 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e1752dbe-70b7-4449-a8ae-6a0dfcb3e114 tempest-VolumesActionsTest-84696 None] Lock "cinder-067d1438-253e-4bf1-b732-0b6a84f2b093-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:05:06 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e1752dbe-70b7-4449-a8ae-6a0dfcb3e114 tempest-VolumesActionsTest-84696 None] Acquiring lock "cinder-quobyte-067d1438-253e-4bf1-b732-0b6a84f2b093" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:05:06 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e1752dbe-70b7-4449-a8ae-6a0dfcb3e114 tempest-VolumesActionsTest-84696 None] Lock "cinder-quobyte-067d1438-253e-4bf1-b732-0b6a84f2b093" acquired by "delete_volume" :: waited 0.019s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:05:06 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cc2fd1-5f65-4ac4-88c0-702b1f919741]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:05:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e1752dbe-70b7-4449-a8ae-6a0dfcb3e114 tempest-VolumesActionsTest-84696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-067d1438-253e-4bf1-b732-0b6a84f2b093 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:06 devstack sudo[89302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-067d1438-253e-4bf1-b732-0b6a84f2b093 Apr 16 23:05:06 devstack sudo[89302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:07 devstack sudo[89302]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e1752dbe-70b7-4449-a8ae-6a0dfcb3e114 tempest-VolumesActionsTest-84696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-067d1438-253e-4bf1-b732-0b6a84f2b093" returned: 0 in 0.726s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e1752dbe-70b7-4449-a8ae-6a0dfcb3e114 tempest-VolumesActionsTest-84696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-067d1438-253e-4bf1-b732-0b6a84f2b093 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:07 devstack sudo[89307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-067d1438-253e-4bf1-b732-0b6a84f2b093 Apr 16 23:05:07 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:07 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e1752dbe-70b7-4449-a8ae-6a0dfcb3e114 tempest-VolumesActionsTest-84696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-067d1438-253e-4bf1-b732-0b6a84f2b093" returned: 0 in 0.548s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:07 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e1752dbe-70b7-4449-a8ae-6a0dfcb3e114 tempest-VolumesActionsTest-84696 None] Lock "cinder-quobyte-067d1438-253e-4bf1-b732-0b6a84f2b093" released by "delete_volume" :: held 1.305s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:05:07 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-e1752dbe-70b7-4449-a8ae-6a0dfcb3e114 tempest-VolumesActionsTest-84696 None] Created reservations ['ea0c022a-9214-4588-a424-7918c50ece82', '3c884fef-5a3c-4e74-8d07-d29e3bf2b4b7', '3710890d-ac75-4777-8db3-4e1ccdd8038e', '7339ec2b-a284-488f-b975-8187e9affd0c'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:05:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e1752dbe-70b7-4449-a8ae-6a0dfcb3e114 tempest-VolumesActionsTest-84696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:05:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e1752dbe-70b7-4449-a8ae-6a0dfcb3e114 tempest-VolumesActionsTest-84696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:05:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e1752dbe-70b7-4449-a8ae-6a0dfcb3e114 tempest-VolumesActionsTest-84696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:05:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e1752dbe-70b7-4449-a8ae-6a0dfcb3e114 tempest-VolumesActionsTest-84696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:05:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e1752dbe-70b7-4449-a8ae-6a0dfcb3e114 tempest-VolumesActionsTest-84696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:05:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e1752dbe-70b7-4449-a8ae-6a0dfcb3e114 tempest-VolumesActionsTest-84696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:08 devstack sudo[89310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:05:08 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:08 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e1752dbe-70b7-4449-a8ae-6a0dfcb3e114 tempest-VolumesActionsTest-84696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.508s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:08 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-e1752dbe-70b7-4449-a8ae-6a0dfcb3e114 tempest-VolumesActionsTest-84696 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:05:08 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-e1752dbe-70b7-4449-a8ae-6a0dfcb3e114 tempest-VolumesActionsTest-84696 None] Deleted volume successfully. Apr 16 23:05:08 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e1752dbe-70b7-4449-a8ae-6a0dfcb3e114 tempest-VolumesActionsTest-84696 None] Lock "cinder-067d1438-253e-4bf1-b732-0b6a84f2b093-delete_volume" released by "delete_volume" :: held 2.027s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:05:09 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:05:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Flow 'volume_create_manager' (0a207f55-d925-4ed1-826e-5ace50fb7dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:05:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4380a800-6ab5-4b98-b488-ca4c2161a8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4380a800-6ab5-4b98-b488-ca4c2161a8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2126851103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=906bfcab-a66f-4383-8f8c-6f92301f41de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f0e71b7e0f4bdc897cb989e63c9bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:05:09Z,use_quota=True,user_id='f6a6277311214b63a305d3334cff4abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6478b05-633c-421d-9d4f-f89d7ca2d32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6478b05-633c-421d-9d4f-f89d7ca2d32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3fdfd54-1283-4945-91d8-2243f9f1877e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3fdfd54-1283-4945-91d8-2243f9f1877e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '906bfcab-a66f-4383-8f8c-6f92301f41de', 'volume_name': 'volume-906bfcab-a66f-4383-8f8c-6f92301f41de', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca966dc-b63b-4ff7-8f59-ec9d5364a182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca966dc-b63b-4ff7-8f59-ec9d5364a182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d16186-62a7-4861-88c4-3fdc4a7c9416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:09 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Volume 906bfcab-a66f-4383-8f8c-6f92301f41de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-906bfcab-a66f-4383-8f8c-6f92301f41de', 'volume_size': 1} Apr 16 23:05:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:05:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:05:09 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2126851103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=906bfcab-a66f-4383-8f8c-6f92301f41de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f0e71b7e0f4bdc897cb989e63c9bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:05:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:05:09Z,use_quota=True,user_id='f6a6277311214b63a305d3334cff4abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:05:09 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Creating volume 906bfcab-a66f-4383-8f8c-6f92301f41de {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:05:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:05:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:05:09 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:05:09 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:05:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:05:09 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:05:09 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:05:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-906bfcab-a66f-4383-8f8c-6f92301f41de 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:09 devstack sudo[89313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-906bfcab-a66f-4383-8f8c-6f92301f41de 1073741824 Apr 16 23:05:09 devstack sudo[89313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:09 devstack sudo[89313]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-906bfcab-a66f-4383-8f8c-6f92301f41de 1073741824" returned: 0 in 0.663s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-906bfcab-a66f-4383-8f8c-6f92301f41de {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:09 devstack sudo[89318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-906bfcab-a66f-4383-8f8c-6f92301f41de Apr 16 23:05:09 devstack sudo[89318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:10 devstack sudo[89318]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-906bfcab-a66f-4383-8f8c-6f92301f41de" returned: 0 in 0.439s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:05:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:05:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0d16186-62a7-4861-88c4-3fdc4a7c9416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-906bfcab-a66f-4383-8f8c-6f92301f41de', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (836768dd-c68f-4478-8a40-eb1823ca014f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:10 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Volume volume-906bfcab-a66f-4383-8f8c-6f92301f41de (906bfcab-a66f-4383-8f8c-6f92301f41de): created successfully Apr 16 23:05:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (836768dd-c68f-4478-8a40-eb1823ca014f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Flow 'volume_create_manager' (0a207f55-d925-4ed1-826e-5ace50fb7dbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:05:10 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-dfa1bdfd-be32-488e-acf2-5a658444589a tempest-VolumesActionsTest-1059813548 None] Created volume successfully. Apr 16 23:05:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e69026a7-2d5a-4a2c-a660-f8d0fa259aa2 tempest-VolumesActionsTest-84696 None] Acquiring lock "cinder-906bfcab-a66f-4383-8f8c-6f92301f41de-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:05:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e69026a7-2d5a-4a2c-a660-f8d0fa259aa2 tempest-VolumesActionsTest-84696 None] Lock "cinder-906bfcab-a66f-4383-8f8c-6f92301f41de-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:05:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e69026a7-2d5a-4a2c-a660-f8d0fa259aa2 tempest-VolumesActionsTest-84696 None] Acquiring lock "cinder-quobyte-906bfcab-a66f-4383-8f8c-6f92301f41de" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:05:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e69026a7-2d5a-4a2c-a660-f8d0fa259aa2 tempest-VolumesActionsTest-84696 None] Lock "cinder-quobyte-906bfcab-a66f-4383-8f8c-6f92301f41de" acquired by "delete_volume" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:05:11 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a9f28a-de5d-43b5-8517-e060497e24b0]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:05:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e69026a7-2d5a-4a2c-a660-f8d0fa259aa2 tempest-VolumesActionsTest-84696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-906bfcab-a66f-4383-8f8c-6f92301f41de {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:11 devstack sudo[89321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-906bfcab-a66f-4383-8f8c-6f92301f41de Apr 16 23:05:11 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:11 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e69026a7-2d5a-4a2c-a660-f8d0fa259aa2 tempest-VolumesActionsTest-84696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-906bfcab-a66f-4383-8f8c-6f92301f41de" returned: 0 in 0.482s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e69026a7-2d5a-4a2c-a660-f8d0fa259aa2 tempest-VolumesActionsTest-84696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-906bfcab-a66f-4383-8f8c-6f92301f41de {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:11 devstack sudo[89326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-906bfcab-a66f-4383-8f8c-6f92301f41de Apr 16 23:05:11 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:12 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e69026a7-2d5a-4a2c-a660-f8d0fa259aa2 tempest-VolumesActionsTest-84696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-906bfcab-a66f-4383-8f8c-6f92301f41de" returned: 0 in 0.453s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:12 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e69026a7-2d5a-4a2c-a660-f8d0fa259aa2 tempest-VolumesActionsTest-84696 None] Lock "cinder-quobyte-906bfcab-a66f-4383-8f8c-6f92301f41de" released by "delete_volume" :: held 0.959s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:05:12 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-e69026a7-2d5a-4a2c-a660-f8d0fa259aa2 tempest-VolumesActionsTest-84696 None] Created reservations ['9553bc5f-f869-427e-8abc-cb457d6f1d9a', '901f3c44-c335-41c9-874e-466d005881cb', 'daa3d64a-0801-416f-b055-951804a735b4', '347bbbef-4a1b-4cdd-824b-ada83ced223a'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:05:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e69026a7-2d5a-4a2c-a660-f8d0fa259aa2 tempest-VolumesActionsTest-84696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:05:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e69026a7-2d5a-4a2c-a660-f8d0fa259aa2 tempest-VolumesActionsTest-84696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:05:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e69026a7-2d5a-4a2c-a660-f8d0fa259aa2 tempest-VolumesActionsTest-84696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:05:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e69026a7-2d5a-4a2c-a660-f8d0fa259aa2 tempest-VolumesActionsTest-84696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:05:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e69026a7-2d5a-4a2c-a660-f8d0fa259aa2 tempest-VolumesActionsTest-84696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:05:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e69026a7-2d5a-4a2c-a660-f8d0fa259aa2 tempest-VolumesActionsTest-84696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:12 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:05:12 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:12 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e69026a7-2d5a-4a2c-a660-f8d0fa259aa2 tempest-VolumesActionsTest-84696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.410s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:12 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-e69026a7-2d5a-4a2c-a660-f8d0fa259aa2 tempest-VolumesActionsTest-84696 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:05:12 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-e69026a7-2d5a-4a2c-a660-f8d0fa259aa2 tempest-VolumesActionsTest-84696 None] Deleted volume successfully. Apr 16 23:05:12 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e69026a7-2d5a-4a2c-a660-f8d0fa259aa2 tempest-VolumesActionsTest-84696 None] Lock "cinder-906bfcab-a66f-4383-8f8c-6f92301f41de-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:05:13 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:05:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Flow 'volume_create_manager' (6ed52713-5b19-402e-b1cb-a6b325e397e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:05:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75451e8d-3b7c-4c90-b8c9-270529956900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75451e8d-3b7c-4c90-b8c9-270529956900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-286136068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3daededa-99e3-431e-8ad0-b323a604d686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f0e71b7e0f4bdc897cb989e63c9bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:05:14Z,use_quota=True,user_id='f6a6277311214b63a305d3334cff4abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (076940cf-0509-4200-8070-b68d8ca6736e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (076940cf-0509-4200-8070-b68d8ca6736e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0f7728-a6fe-4a99-9610-7aa7b89fb24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0f7728-a6fe-4a99-9610-7aa7b89fb24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3daededa-99e3-431e-8ad0-b323a604d686', 'volume_name': 'volume-3daededa-99e3-431e-8ad0-b323a604d686', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb45545-055f-4311-ba32-f2d188fcdd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb45545-055f-4311-ba32-f2d188fcdd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:13 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72b8c4e-7932-44d9-b83d-46fece1c6cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:13 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Volume 3daededa-99e3-431e-8ad0-b323a604d686: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3daededa-99e3-431e-8ad0-b323a604d686', 'volume_size': 1} Apr 16 23:05:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:05:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:05:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-286136068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3daededa-99e3-431e-8ad0-b323a604d686,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f0e71b7e0f4bdc897cb989e63c9bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:05:14Z,use_quota=True,user_id='f6a6277311214b63a305d3334cff4abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:05:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Creating volume 3daededa-99e3-431e-8ad0-b323a604d686 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:05:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:05:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:05:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:05:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:05:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:05:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:05:13 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:05:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3daededa-99e3-431e-8ad0-b323a604d686 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:13 devstack sudo[89334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3daededa-99e3-431e-8ad0-b323a604d686 1073741824 Apr 16 23:05:13 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:14 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3daededa-99e3-431e-8ad0-b323a604d686 1073741824" returned: 0 in 0.703s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3daededa-99e3-431e-8ad0-b323a604d686 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:14 devstack sudo[89339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3daededa-99e3-431e-8ad0-b323a604d686 Apr 16 23:05:14 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:15 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3daededa-99e3-431e-8ad0-b323a604d686" returned: 0 in 0.688s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:05:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:05:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f72b8c4e-7932-44d9-b83d-46fece1c6cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3daededa-99e3-431e-8ad0-b323a604d686', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e419cbe0-24b4-41b1-bcb8-3d7d6dc931dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:15 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Volume volume-3daededa-99e3-431e-8ad0-b323a604d686 (3daededa-99e3-431e-8ad0-b323a604d686): created successfully Apr 16 23:05:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e419cbe0-24b4-41b1-bcb8-3d7d6dc931dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:15 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Flow 'volume_create_manager' (6ed52713-5b19-402e-b1cb-a6b325e397e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:05:15 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-b48e1cff-38f0-4790-b7db-12f2f28e1735 tempest-VolumesActionsTest-1059813548 None] Created volume successfully. Apr 16 23:05:16 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e0b5c931-216f-4a7e-9a89-9772a5f5e9e3 tempest-VolumesActionsTest-84696 None] Acquiring lock "cinder-3daededa-99e3-431e-8ad0-b323a604d686-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:05:16 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e0b5c931-216f-4a7e-9a89-9772a5f5e9e3 tempest-VolumesActionsTest-84696 None] Lock "cinder-3daededa-99e3-431e-8ad0-b323a604d686-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:05:16 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e0b5c931-216f-4a7e-9a89-9772a5f5e9e3 tempest-VolumesActionsTest-84696 None] Acquiring lock "cinder-quobyte-3daededa-99e3-431e-8ad0-b323a604d686" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:05:16 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e0b5c931-216f-4a7e-9a89-9772a5f5e9e3 tempest-VolumesActionsTest-84696 None] Lock "cinder-quobyte-3daededa-99e3-431e-8ad0-b323a604d686" acquired by "delete_volume" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:05:16 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[696d090a-2c6c-4dc5-9755-87b5da76a3dd]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:05:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e0b5c931-216f-4a7e-9a89-9772a5f5e9e3 tempest-VolumesActionsTest-84696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3daededa-99e3-431e-8ad0-b323a604d686 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:16 devstack sudo[89343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3daededa-99e3-431e-8ad0-b323a604d686 Apr 16 23:05:16 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:16 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e0b5c931-216f-4a7e-9a89-9772a5f5e9e3 tempest-VolumesActionsTest-84696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3daededa-99e3-431e-8ad0-b323a604d686" returned: 0 in 0.628s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e0b5c931-216f-4a7e-9a89-9772a5f5e9e3 tempest-VolumesActionsTest-84696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3daededa-99e3-431e-8ad0-b323a604d686 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:16 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3daededa-99e3-431e-8ad0-b323a604d686 Apr 16 23:05:16 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:17 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e0b5c931-216f-4a7e-9a89-9772a5f5e9e3 tempest-VolumesActionsTest-84696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3daededa-99e3-431e-8ad0-b323a604d686" returned: 0 in 0.537s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:17 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e0b5c931-216f-4a7e-9a89-9772a5f5e9e3 tempest-VolumesActionsTest-84696 None] Lock "cinder-quobyte-3daededa-99e3-431e-8ad0-b323a604d686" released by "delete_volume" :: held 1.201s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:05:17 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-e0b5c931-216f-4a7e-9a89-9772a5f5e9e3 tempest-VolumesActionsTest-84696 None] Created reservations ['db5ccf3b-0d68-40e0-b895-f19e54f2ce37', 'df01baf3-b562-4c8a-9b07-ef92af98e6d6', 'cfec516a-5462-4ba0-9910-d8965c15c629', '78d14147-bd22-4f7f-b831-02af162c481f'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:05:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e0b5c931-216f-4a7e-9a89-9772a5f5e9e3 tempest-VolumesActionsTest-84696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:05:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e0b5c931-216f-4a7e-9a89-9772a5f5e9e3 tempest-VolumesActionsTest-84696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:05:17 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e0b5c931-216f-4a7e-9a89-9772a5f5e9e3 tempest-VolumesActionsTest-84696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:05:17 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e0b5c931-216f-4a7e-9a89-9772a5f5e9e3 tempest-VolumesActionsTest-84696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:05:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e0b5c931-216f-4a7e-9a89-9772a5f5e9e3 tempest-VolumesActionsTest-84696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:05:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e0b5c931-216f-4a7e-9a89-9772a5f5e9e3 tempest-VolumesActionsTest-84696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:17 devstack sudo[89351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:05:17 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:18 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e0b5c931-216f-4a7e-9a89-9772a5f5e9e3 tempest-VolumesActionsTest-84696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.586s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:18 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-e0b5c931-216f-4a7e-9a89-9772a5f5e9e3 tempest-VolumesActionsTest-84696 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:05:18 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-e0b5c931-216f-4a7e-9a89-9772a5f5e9e3 tempest-VolumesActionsTest-84696 None] Deleted volume successfully. Apr 16 23:05:18 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e0b5c931-216f-4a7e-9a89-9772a5f5e9e3 tempest-VolumesActionsTest-84696 None] Lock "cinder-3daededa-99e3-431e-8ad0-b323a604d686-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:05:18 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:05:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Flow 'volume_create_manager' (a8538191-b61b-4f09-808e-52518bfdb78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:05:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef7b03d3-968e-40cc-beee-3cd57f7f262b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef7b03d3-968e-40cc-beee-3cd57f7f262b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1617904855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72be8347-c17b-4375-ab63-ca8f524576c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f0e71b7e0f4bdc897cb989e63c9bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:05:19Z,use_quota=True,user_id='f6a6277311214b63a305d3334cff4abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (604e7767-f246-4f86-a4e3-159f2a892943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (604e7767-f246-4f86-a4e3-159f2a892943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (369f0dfb-b5f6-409f-b99b-2377551f4706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (369f0dfb-b5f6-409f-b99b-2377551f4706) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72be8347-c17b-4375-ab63-ca8f524576c4', 'volume_name': 'volume-72be8347-c17b-4375-ab63-ca8f524576c4', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63fdb016-c36d-44b9-bf59-47a2cec75eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63fdb016-c36d-44b9-bf59-47a2cec75eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b18da2c-a4a3-4ab1-9a1b-5902786b6d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:18 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Volume 72be8347-c17b-4375-ab63-ca8f524576c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72be8347-c17b-4375-ab63-ca8f524576c4', 'volume_size': 1} Apr 16 23:05:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:05:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:05:18 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1617904855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72be8347-c17b-4375-ab63-ca8f524576c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f0e71b7e0f4bdc897cb989e63c9bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:05:19Z,use_quota=True,user_id='f6a6277311214b63a305d3334cff4abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:05:18 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Creating volume 72be8347-c17b-4375-ab63-ca8f524576c4 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:05:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:05:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:05:18 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:05:18 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:05:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:05:18 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:05:18 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:05:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-72be8347-c17b-4375-ab63-ca8f524576c4 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:18 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-72be8347-c17b-4375-ab63-ca8f524576c4 1073741824 Apr 16 23:05:18 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:19 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-72be8347-c17b-4375-ab63-ca8f524576c4 1073741824" returned: 0 in 0.711s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-72be8347-c17b-4375-ab63-ca8f524576c4 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:19 devstack sudo[89359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-72be8347-c17b-4375-ab63-ca8f524576c4 Apr 16 23:05:19 devstack sudo[89359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:20 devstack sudo[89359]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-72be8347-c17b-4375-ab63-ca8f524576c4" returned: 0 in 0.511s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:20 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:05:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:05:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b18da2c-a4a3-4ab1-9a1b-5902786b6d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72be8347-c17b-4375-ab63-ca8f524576c4', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f66917-867f-44d1-bc61-ffcb5680a857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:20 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Volume volume-72be8347-c17b-4375-ab63-ca8f524576c4 (72be8347-c17b-4375-ab63-ca8f524576c4): created successfully Apr 16 23:05:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26f66917-867f-44d1-bc61-ffcb5680a857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Flow 'volume_create_manager' (a8538191-b61b-4f09-808e-52518bfdb78a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:05:20 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-2b3f0da4-749d-4672-abfb-7c0940321562 tempest-VolumesActionsTest-1059813548 None] Created volume successfully. Apr 16 23:05:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-fe1662d0-7785-4842-a6e5-f79e5ba109f9 tempest-VolumesActionsTest-84696 None] Acquiring lock "cinder-72be8347-c17b-4375-ab63-ca8f524576c4-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:05:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-fe1662d0-7785-4842-a6e5-f79e5ba109f9 tempest-VolumesActionsTest-84696 None] Lock "cinder-72be8347-c17b-4375-ab63-ca8f524576c4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:05:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-fe1662d0-7785-4842-a6e5-f79e5ba109f9 tempest-VolumesActionsTest-84696 None] Acquiring lock "cinder-quobyte-72be8347-c17b-4375-ab63-ca8f524576c4" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:05:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-fe1662d0-7785-4842-a6e5-f79e5ba109f9 tempest-VolumesActionsTest-84696 None] Lock "cinder-quobyte-72be8347-c17b-4375-ab63-ca8f524576c4" acquired by "delete_volume" :: waited 0.009s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:05:21 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[8310485e-c8b7-416e-b53a-27a68751e83f]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:05:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-fe1662d0-7785-4842-a6e5-f79e5ba109f9 tempest-VolumesActionsTest-84696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-72be8347-c17b-4375-ab63-ca8f524576c4 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:21 devstack sudo[89362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-72be8347-c17b-4375-ab63-ca8f524576c4 Apr 16 23:05:21 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:21 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-fe1662d0-7785-4842-a6e5-f79e5ba109f9 tempest-VolumesActionsTest-84696 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-72be8347-c17b-4375-ab63-ca8f524576c4" returned: 0 in 0.597s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-fe1662d0-7785-4842-a6e5-f79e5ba109f9 tempest-VolumesActionsTest-84696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-72be8347-c17b-4375-ab63-ca8f524576c4 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:21 devstack sudo[89367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-72be8347-c17b-4375-ab63-ca8f524576c4 Apr 16 23:05:21 devstack sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:22 devstack sudo[89367]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-fe1662d0-7785-4842-a6e5-f79e5ba109f9 tempest-VolumesActionsTest-84696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-72be8347-c17b-4375-ab63-ca8f524576c4" returned: 0 in 0.485s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-fe1662d0-7785-4842-a6e5-f79e5ba109f9 tempest-VolumesActionsTest-84696 None] Lock "cinder-quobyte-72be8347-c17b-4375-ab63-ca8f524576c4" released by "delete_volume" :: held 1.115s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:05:22 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-fe1662d0-7785-4842-a6e5-f79e5ba109f9 tempest-VolumesActionsTest-84696 None] Created reservations ['3a84b018-2c84-43a7-94d3-d2acce848343', '108f34b2-100c-451c-916d-dc1f62807ecf', '074b56a8-7569-4eae-8c75-313403c0ff5a', 'bcc7cf5b-4d7b-49b0-8bf0-01e91f00c1a9'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:05:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-fe1662d0-7785-4842-a6e5-f79e5ba109f9 tempest-VolumesActionsTest-84696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:05:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-fe1662d0-7785-4842-a6e5-f79e5ba109f9 tempest-VolumesActionsTest-84696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:05:22 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-fe1662d0-7785-4842-a6e5-f79e5ba109f9 tempest-VolumesActionsTest-84696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:05:22 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-fe1662d0-7785-4842-a6e5-f79e5ba109f9 tempest-VolumesActionsTest-84696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:05:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-fe1662d0-7785-4842-a6e5-f79e5ba109f9 tempest-VolumesActionsTest-84696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:05:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-fe1662d0-7785-4842-a6e5-f79e5ba109f9 tempest-VolumesActionsTest-84696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:22 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:05:22 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:22 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-fe1662d0-7785-4842-a6e5-f79e5ba109f9 tempest-VolumesActionsTest-84696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.680s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-fe1662d0-7785-4842-a6e5-f79e5ba109f9 tempest-VolumesActionsTest-84696 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:05:23 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-fe1662d0-7785-4842-a6e5-f79e5ba109f9 tempest-VolumesActionsTest-84696 None] Deleted volume successfully. Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-fe1662d0-7785-4842-a6e5-f79e5ba109f9 tempest-VolumesActionsTest-84696 None] Lock "cinder-72be8347-c17b-4375-ab63-ca8f524576c4-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:UPDATE=94,cinder:DELETE=6,cinder:SELECT=71,cinder:INSERT=15 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:SELECT=63,cinder:INSERT=26,cinder:UPDATE=81,cinder:DELETE=9 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Flow 'volume_create_manager' (8c2262fb-8419-4bc7-a88a-c352dab7187d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f060e6-8d2c-4e96-82c5-75008a44acba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60f060e6-8d2c-4e96-82c5-75008a44acba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1310620969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c0741e-472e-4535-9568-72b1695c0af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f0e71b7e0f4bdc897cb989e63c9bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:05:24Z,use_quota=True,user_id='f6a6277311214b63a305d3334cff4abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f21ea5d-d90e-4eb4-9e05-ec7a1cf57017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f21ea5d-d90e-4eb4-9e05-ec7a1cf57017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7b9bc4-36bb-4e63-a56b-d1301830b64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da7b9bc4-36bb-4e63-a56b-d1301830b64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01c0741e-472e-4535-9568-72b1695c0af7', 'volume_name': 'volume-01c0741e-472e-4535-9568-72b1695c0af7', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4897c92-bacf-4d50-a838-579a218c24c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4897c92-bacf-4d50-a838-579a218c24c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf141d7a-7145-44e3-8656-9a056df8761c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:23 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Volume 01c0741e-472e-4535-9568-72b1695c0af7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01c0741e-472e-4535-9568-72b1695c0af7', 'volume_size': 1} Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1310620969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01c0741e-472e-4535-9568-72b1695c0af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2f0e71b7e0f4bdc897cb989e63c9bd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:05:24Z,use_quota=True,user_id='f6a6277311214b63a305d3334cff4abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Creating volume 01c0741e-472e-4535-9568-72b1695c0af7 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:05:23 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:05:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-01c0741e-472e-4535-9568-72b1695c0af7 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:23 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-01c0741e-472e-4535-9568-72b1695c0af7 1073741824 Apr 16 23:05:23 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:24 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-01c0741e-472e-4535-9568-72b1695c0af7 1073741824" returned: 0 in 0.559s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-01c0741e-472e-4535-9568-72b1695c0af7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:24 devstack sudo[89379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-01c0741e-472e-4535-9568-72b1695c0af7 Apr 16 23:05:24 devstack sudo[89379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:24 devstack sudo[89379]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-01c0741e-472e-4535-9568-72b1695c0af7" returned: 0 in 0.454s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:24 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:05:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:05:24 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf141d7a-7145-44e3-8656-9a056df8761c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01c0741e-472e-4535-9568-72b1695c0af7', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:24 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2234a5-34e1-4fd7-9015-5ea1d4741c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:24 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Volume volume-01c0741e-472e-4535-9568-72b1695c0af7 (01c0741e-472e-4535-9568-72b1695c0af7): created successfully Apr 16 23:05:24 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2234a5-34e1-4fd7-9015-5ea1d4741c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:24 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Flow 'volume_create_manager' (8c2262fb-8419-4bc7-a88a-c352dab7187d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:05:24 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-66654f7a-2a44-4843-9740-0047c404c94b tempest-VolumesActionsTest-1059813548 None] Created volume successfully. Apr 16 23:05:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-fbd45e6f-091a-4cec-a04f-5997317bb183 tempest-VolumesActionsTest-1059813548 None] Acquiring lock "cinder-01c0741e-472e-4535-9568-72b1695c0af7-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:05:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-fbd45e6f-091a-4cec-a04f-5997317bb183 tempest-VolumesActionsTest-1059813548 None] Lock "cinder-01c0741e-472e-4535-9568-72b1695c0af7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:05:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-fbd45e6f-091a-4cec-a04f-5997317bb183 tempest-VolumesActionsTest-1059813548 None] Acquiring lock "cinder-quobyte-01c0741e-472e-4535-9568-72b1695c0af7" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:05:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-fbd45e6f-091a-4cec-a04f-5997317bb183 tempest-VolumesActionsTest-1059813548 None] Lock "cinder-quobyte-01c0741e-472e-4535-9568-72b1695c0af7" acquired by "delete_volume" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:05:26 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[96721b42-43da-4fba-be1e-c1a4b948131c]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:05:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-fbd45e6f-091a-4cec-a04f-5997317bb183 tempest-VolumesActionsTest-1059813548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-01c0741e-472e-4535-9568-72b1695c0af7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:26 devstack sudo[89382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-01c0741e-472e-4535-9568-72b1695c0af7 Apr 16 23:05:26 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:26 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-fbd45e6f-091a-4cec-a04f-5997317bb183 tempest-VolumesActionsTest-1059813548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-01c0741e-472e-4535-9568-72b1695c0af7" returned: 0 in 0.493s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-fbd45e6f-091a-4cec-a04f-5997317bb183 tempest-VolumesActionsTest-1059813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-01c0741e-472e-4535-9568-72b1695c0af7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:26 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-01c0741e-472e-4535-9568-72b1695c0af7 Apr 16 23:05:26 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:27 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-fbd45e6f-091a-4cec-a04f-5997317bb183 tempest-VolumesActionsTest-1059813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-01c0741e-472e-4535-9568-72b1695c0af7" returned: 0 in 0.418s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:27 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-fbd45e6f-091a-4cec-a04f-5997317bb183 tempest-VolumesActionsTest-1059813548 None] Lock "cinder-quobyte-01c0741e-472e-4535-9568-72b1695c0af7" released by "delete_volume" :: held 0.943s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:05:27 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-fbd45e6f-091a-4cec-a04f-5997317bb183 tempest-VolumesActionsTest-1059813548 None] Created reservations ['2d49941b-a600-4706-9f48-86add75e124b', 'c3f05a0f-187d-4c36-84df-2c23a6d9ebc8', 'd19e2814-08dc-4cb5-abb4-d5c927163448', '8cae7720-71a3-420f-b1a6-21c2f91e55bf'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:05:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-fbd45e6f-091a-4cec-a04f-5997317bb183 tempest-VolumesActionsTest-1059813548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:05:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-fbd45e6f-091a-4cec-a04f-5997317bb183 tempest-VolumesActionsTest-1059813548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:05:27 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-fbd45e6f-091a-4cec-a04f-5997317bb183 tempest-VolumesActionsTest-1059813548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:05:27 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-fbd45e6f-091a-4cec-a04f-5997317bb183 tempest-VolumesActionsTest-1059813548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:05:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-fbd45e6f-091a-4cec-a04f-5997317bb183 tempest-VolumesActionsTest-1059813548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:05:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-fbd45e6f-091a-4cec-a04f-5997317bb183 tempest-VolumesActionsTest-1059813548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:27 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:05:27 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:27 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-fbd45e6f-091a-4cec-a04f-5997317bb183 tempest-VolumesActionsTest-1059813548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.516s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:27 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-fbd45e6f-091a-4cec-a04f-5997317bb183 tempest-VolumesActionsTest-1059813548 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:05:27 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-fbd45e6f-091a-4cec-a04f-5997317bb183 tempest-VolumesActionsTest-1059813548 None] Deleted volume successfully. Apr 16 23:05:27 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-fbd45e6f-091a-4cec-a04f-5997317bb183 tempest-VolumesActionsTest-1059813548 None] Lock "cinder-01c0741e-472e-4535-9568-72b1695c0af7-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:05:36 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:05:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Flow 'volume_create_manager' (1bdccae3-b230-4e3b-ad85-c5a3f8d2663b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:05:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687ad3ee-bb8c-461c-931d-db5de21b9f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (687ad3ee-bb8c-461c-931d-db5de21b9f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-8483453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3c5186-385b-4ff4-bc05-50b047674626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ae24c6bd414b23bc93e561545b3d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:05:37Z,use_quota=True,user_id='b4909adffb4649f1ab62b83443d8a853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4893cabc-8504-42c2-a053-d4f175ffdd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4893cabc-8504-42c2-a053-d4f175ffdd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a1a38d-cb46-4164-99fa-a429451b6f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a1a38d-cb46-4164-99fa-a429451b6f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e3c5186-385b-4ff4-bc05-50b047674626', 'volume_name': 'volume-6e3c5186-385b-4ff4-bc05-50b047674626', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627f942b-fc7d-4e63-b046-a04994345d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627f942b-fc7d-4e63-b046-a04994345d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d720b27-9a97-46b1-9475-ed98885701b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:36 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Volume 6e3c5186-385b-4ff4-bc05-50b047674626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e3c5186-385b-4ff4-bc05-50b047674626', 'volume_size': 1} Apr 16 23:05:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:05:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:05:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-8483453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3c5186-385b-4ff4-bc05-50b047674626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ae24c6bd414b23bc93e561545b3d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:05:37Z,use_quota=True,user_id='b4909adffb4649f1ab62b83443d8a853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:05:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Creating volume 6e3c5186-385b-4ff4-bc05-50b047674626 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:05:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:05:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:05:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:05:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:05:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:05:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:05:36 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:05:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:36 devstack sudo[89401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626 1073741824 Apr 16 23:05:36 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:37 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626 1073741824" returned: 0 in 0.544s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:37 devstack sudo[89406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626 Apr 16 23:05:37 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:38 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626" returned: 0 in 0.588s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:38 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:05:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:05:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d720b27-9a97-46b1-9475-ed98885701b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e3c5186-385b-4ff4-bc05-50b047674626', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ac93ee-5bf2-4d55-a50e-19f580a6a504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:38 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Volume volume-6e3c5186-385b-4ff4-bc05-50b047674626 (6e3c5186-385b-4ff4-bc05-50b047674626): created successfully Apr 16 23:05:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26ac93ee-5bf2-4d55-a50e-19f580a6a504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Flow 'volume_create_manager' (1bdccae3-b230-4e3b-ad85-c5a3f8d2663b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:05:38 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-d4401e7c-600c-49dd-9688-f9a8a0baf5bc tempest-VolumesDeleteCascade-1763633411 None] Created volume successfully. Apr 16 23:05:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0ea93b6f-077a-48c9-b2bd-1e781d4e529b tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:05:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0ea93b6f-077a-48c9-b2bd-1e781d4e529b tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:05:39 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-0ea93b6f-077a-48c9-b2bd-1e781d4e529b tempest-VolumesDeleteCascade-1763633411 None] Creating offline snapshot 0d49dd97-bcb5-498b-abba-9d03951fecfa of volume 6e3c5186-385b-4ff4-bc05-50b047674626 {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:05:39 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42d7761-72c0-4139-bc79-ead57ebc50df]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:05:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0ea93b6f-077a-48c9-b2bd-1e781d4e529b tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:39 devstack sudo[89409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626 Apr 16 23:05:39 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:39 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0ea93b6f-077a-48c9-b2bd-1e781d4e529b tempest-VolumesDeleteCascade-1763633411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626" returned: 0 in 0.602s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0ea93b6f-077a-48c9-b2bd-1e781d4e529b tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:39 devstack sudo[89414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa 1G Apr 16 23:05:39 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:40 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0ea93b6f-077a-48c9-b2bd-1e781d4e529b tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa 1G" returned: 0 in 0.674s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0ea93b6f-077a-48c9-b2bd-1e781d4e529b tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e3c5186-385b-4ff4-bc05-50b047674626 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:40 devstack sudo[89419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e3c5186-385b-4ff4-bc05-50b047674626 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa Apr 16 23:05:40 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:40 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0ea93b6f-077a-48c9-b2bd-1e781d4e529b tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e3c5186-385b-4ff4-bc05-50b047674626 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa" returned: 0 in 0.610s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:41 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-0ea93b6f-077a-48c9-b2bd-1e781d4e529b tempest-VolumesDeleteCascade-1763633411 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa is being set with open permissions: ugo+rw Apr 16 23:05:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0ea93b6f-077a-48c9-b2bd-1e781d4e529b tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:41 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa Apr 16 23:05:41 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:41 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0ea93b6f-077a-48c9-b2bd-1e781d4e529b tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa" returned: 0 in 0.578s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0ea93b6f-077a-48c9-b2bd-1e781d4e529b tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:41 devstack sudo[89427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.info Apr 16 23:05:41 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:42 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0ea93b6f-077a-48c9-b2bd-1e781d4e529b tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.info" returned: 0 in 0.555s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:42 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-0ea93b6f-077a-48c9-b2bd-1e781d4e529b tempest-VolumesDeleteCascade-1763633411 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.info is being set with open permissions: ugo+rw Apr 16 23:05:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0ea93b6f-077a-48c9-b2bd-1e781d4e529b tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:42 devstack sudo[89430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.info Apr 16 23:05:42 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:42 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0ea93b6f-077a-48c9-b2bd-1e781d4e529b tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.info" returned: 0 in 0.573s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0ea93b6f-077a-48c9-b2bd-1e781d4e529b tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.673s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:05:42 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-0ea93b6f-077a-48c9-b2bd-1e781d4e529b tempest-VolumesDeleteCascade-1763633411 None] Create snapshot completed successfully Apr 16 23:05:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f5c82495-dd89-478e-a565-297eb084688b tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:05:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f5c82495-dd89-478e-a565-297eb084688b tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:05:43 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-f5c82495-dd89-478e-a565-297eb084688b tempest-VolumesDeleteCascade-1763633411 None] Creating offline snapshot 4099ad83-5202-4d1c-9549-fa6cc9d19402 of volume 6e3c5186-385b-4ff4-bc05-50b047674626 {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:05:43 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[0144dc05-1462-4635-8e17-0696d4264d44]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:05:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f5c82495-dd89-478e-a565-297eb084688b tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:43 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa Apr 16 23:05:43 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:44 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f5c82495-dd89-478e-a565-297eb084688b tempest-VolumesDeleteCascade-1763633411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa" returned: 0 in 0.650s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:44 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-f5c82495-dd89-478e-a565-297eb084688b tempest-VolumesDeleteCascade-1763633411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e3c5186-385b-4ff4-bc05-50b047674626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:05:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f5c82495-dd89-478e-a565-297eb084688b tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:44 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402 1G Apr 16 23:05:44 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:44 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f5c82495-dd89-478e-a565-297eb084688b tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402 1G" returned: 0 in 0.704s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f5c82495-dd89-478e-a565-297eb084688b tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:44 devstack sudo[89444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402 Apr 16 23:05:44 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:45 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f5c82495-dd89-478e-a565-297eb084688b tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402" returned: 0 in 0.481s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:45 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-f5c82495-dd89-478e-a565-297eb084688b tempest-VolumesDeleteCascade-1763633411 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402 is being set with open permissions: ugo+rw Apr 16 23:05:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f5c82495-dd89-478e-a565-297eb084688b tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:45 devstack sudo[89449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402 Apr 16 23:05:45 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:45 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f5c82495-dd89-478e-a565-297eb084688b tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402" returned: 0 in 0.587s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f5c82495-dd89-478e-a565-297eb084688b tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.501s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:05:45 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-f5c82495-dd89-478e-a565-297eb084688b tempest-VolumesDeleteCascade-1763633411 None] Create snapshot completed successfully Apr 16 23:05:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "cinder-6e3c5186-385b-4ff4-bc05-50b047674626-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:05:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-6e3c5186-385b-4ff4-bc05-50b047674626-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:05:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Performing cascade delete. {{(pid=81971) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 16 23:05:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "cinder-0d49dd97-bcb5-498b-abba-9d03951fecfa-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:05:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-0d49dd97-bcb5-498b-abba-9d03951fecfa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:05:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "cinder-quobyte-6e3c5186-385b-4ff4-bc05-50b047674626" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:05:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-quobyte-6e3c5186-385b-4ff4-bc05-50b047674626" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:05:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "cinder-quobyte-0d49dd97-bcb5-498b-abba-9d03951fecfa" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:05:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-quobyte-0d49dd97-bcb5-498b-abba-9d03951fecfa" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:05:46 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Deleting offline snapshot 0d49dd97-bcb5-498b-abba-9d03951fecfa of volume 6e3c5186-385b-4ff4-bc05-50b047674626 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:05:46 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] snapshot_file for this snap is: volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:05:46 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6a843e-e76e-4275-b1c9-eee5ec7eedf3]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:05:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:46 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa Apr 16 23:05:46 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:47 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa" returned: 0 in 0.622s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:47 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e3c5186-385b-4ff4-bc05-50b047674626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:05:47 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[525e2b21-1de2-40a3-8054-7553e6335902]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:05:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:47 devstack sudo[89463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626 Apr 16 23:05:47 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:48 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626" returned: 0 in 0.648s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:48 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[0713d2e1-dddb-48de-bd32-94845b99fdf9]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:05:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:48 devstack sudo[89468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402 Apr 16 23:05:48 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:48 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402" returned: 0 in 0.555s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:48 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e3c5186-385b-4ff4-bc05-50b047674626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:05:48 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f9665e-d7c5-45ec-899b-ac8e689e292c]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:05:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:48 devstack sudo[89473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa Apr 16 23:05:48 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:49 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa" returned: 0 in 0.645s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e3c5186-385b-4ff4-bc05-50b047674626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:05:49 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb90c28b-0907-442a-952c-af1efa1a971c]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:05:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:49 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626 Apr 16 23:05:49 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:49 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626" returned: 0 in 0.504s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:49 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa Apr 16 23:05:49 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:50 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa" returned: 0 in 0.764s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:50 devstack sudo[89488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa Apr 16 23:05:50 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:51 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.0d49dd97-bcb5-498b-abba-9d03951fecfa" returned: 0 in 0.533s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e3c5186-385b-4ff4-bc05-50b047674626 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402 -F qcow2 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:51 devstack sudo[89491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e3c5186-385b-4ff4-bc05-50b047674626 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402 -F qcow2 Apr 16 23:05:51 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:51 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e3c5186-385b-4ff4-bc05-50b047674626 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402 -F qcow2" returned: 0 in 0.630s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:51 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-quobyte-0d49dd97-bcb5-498b-abba-9d03951fecfa" released by "_delete_snapshot" :: held 5.016s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:05:51 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-quobyte-6e3c5186-385b-4ff4-bc05-50b047674626" released by "delete_snapshot" :: held 5.030s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:05:51 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Created reservations ['f7229ac2-e8f3-4a09-a81f-5673ce82b84f', '37e80fb4-fc64-4c5d-a686-a47b11267667', 'aaf3725c-41e9-4434-8d64-a358879448d2', '3b22081b-6017-4d4e-8548-8d1861ad2981'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:05:51 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Delete snapshot completed successfully. Apr 16 23:05:51 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-0d49dd97-bcb5-498b-abba-9d03951fecfa-delete_snapshot" released by "delete_snapshot" :: held 5.176s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:05:51 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "cinder-4099ad83-5202-4d1c-9549-fa6cc9d19402-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:05:51 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-4099ad83-5202-4d1c-9549-fa6cc9d19402-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:05:51 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "cinder-quobyte-6e3c5186-385b-4ff4-bc05-50b047674626" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:05:51 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-quobyte-6e3c5186-385b-4ff4-bc05-50b047674626" acquired by "delete_snapshot" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:05:51 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "cinder-quobyte-4099ad83-5202-4d1c-9549-fa6cc9d19402" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:05:51 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-quobyte-4099ad83-5202-4d1c-9549-fa6cc9d19402" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:05:51 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Deleting offline snapshot 4099ad83-5202-4d1c-9549-fa6cc9d19402 of volume 6e3c5186-385b-4ff4-bc05-50b047674626 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:05:51 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] snapshot_file for this snap is: volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:05:51 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[08df1818-c847-4cd7-a090-79e9a4077c44]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:05:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:52 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402 Apr 16 23:05:52 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:52 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402" returned: 0 in 0.572s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:52 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e3c5186-385b-4ff4-bc05-50b047674626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:05:52 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5352910-2c87-4d2a-8a77-cd2ffa4f37b4]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:05:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:52 devstack sudo[89504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626 Apr 16 23:05:52 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:53 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626" returned: 0 in 0.581s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:53 devstack sudo[89509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402 Apr 16 23:05:53 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:53 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402" returned: 0 in 0.602s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:53 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402 Apr 16 23:05:53 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:54 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626.4099ad83-5202-4d1c-9549-fa6cc9d19402" returned: 0 in 0.519s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:54 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-quobyte-4099ad83-5202-4d1c-9549-fa6cc9d19402" released by "_delete_snapshot" :: held 2.343s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:05:54 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-quobyte-6e3c5186-385b-4ff4-bc05-50b047674626" released by "delete_snapshot" :: held 2.363s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:05:54 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Created reservations ['740cddac-a696-4d33-a33b-e36470fc7915', '71b8d554-9c73-4022-9d46-772db07aa2a7', '775512ff-bb9d-43e9-a2d0-b5f67bfbcb75', '8b445daa-d93d-42a8-b1e1-c6825a7a6d3d'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:05:54 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Delete snapshot completed successfully. Apr 16 23:05:54 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-4099ad83-5202-4d1c-9549-fa6cc9d19402-delete_snapshot" released by "delete_snapshot" :: held 2.497s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:05:54 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Snapshots deleted, issuing volume delete {{(pid=81971) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 16 23:05:54 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "cinder-quobyte-6e3c5186-385b-4ff4-bc05-50b047674626" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:05:54 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-quobyte-6e3c5186-385b-4ff4-bc05-50b047674626" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:05:54 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8ac5bf-ce18-4bed-90dd-ae2eb6e6fb27]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:05:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:54 devstack sudo[89517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626 Apr 16 23:05:54 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:54 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626" returned: 0 in 0.498s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:54 devstack sudo[89522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626 Apr 16 23:05:54 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:55 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-6e3c5186-385b-4ff4-bc05-50b047674626" returned: 0 in 0.491s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:55 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-quobyte-6e3c5186-385b-4ff4-bc05-50b047674626" released by "delete_volume" :: held 1.028s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:05:55 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Created reservations ['a6da3705-0dba-4a81-b4d0-0c5ef2be2e36', 'd1d418a3-d9d0-4cdd-a1de-655bdaf2b4d7', '75f2961a-a6fa-4d0e-9853-babf787f761e', '9e459e24-4de5-4d51-82c5-97336b978b49'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:05:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:05:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:05:55 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:05:55 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:05:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:05:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:55 devstack sudo[89525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:05:55 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:55 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.407s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:55 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:05:55 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Deleted volume successfully. Apr 16 23:05:55 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e8b74759-b693-4ff4-8f75-8262b708cb17 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-6e3c5186-385b-4ff4-bc05-50b047674626-delete_volume" released by "delete_volume" :: held 9.320s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:05:56 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:05:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Flow 'volume_create_manager' (1773de5e-97b6-401a-8b47-4b77511b9ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:05:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c53fed9a-a33c-4f6b-a0a8-c07f666acfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c53fed9a-a33c-4f6b-a0a8-c07f666acfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1166551398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f7f8f6-42c1-43d0-8576-4ffb40cc678a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ae24c6bd414b23bc93e561545b3d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:05:57Z,use_quota=True,user_id='b4909adffb4649f1ab62b83443d8a853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e736fff-3c9b-49e0-b0da-49af6f527ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e736fff-3c9b-49e0-b0da-49af6f527ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b953a44-3ac9-4544-ba10-b036f9e9c25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b953a44-3ac9-4544-ba10-b036f9e9c25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13f7f8f6-42c1-43d0-8576-4ffb40cc678a', 'volume_name': 'volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfe497c-028a-462a-90a8-c1ae7c179c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfe497c-028a-462a-90a8-c1ae7c179c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (925ab971-168c-46ab-926b-bb782d79ed07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:56 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Volume 13f7f8f6-42c1-43d0-8576-4ffb40cc678a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a', 'volume_size': 1} Apr 16 23:05:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:05:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:05:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1166551398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f7f8f6-42c1-43d0-8576-4ffb40cc678a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ae24c6bd414b23bc93e561545b3d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:05:57Z,use_quota=True,user_id='b4909adffb4649f1ab62b83443d8a853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:05:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Creating volume 13f7f8f6-42c1-43d0-8576-4ffb40cc678a {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:05:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:05:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:05:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:05:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:05:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:05:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:05:56 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:05:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:56 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a 1073741824 Apr 16 23:05:56 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:57 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a 1073741824" returned: 0 in 0.738s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:57 devstack sudo[89533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a Apr 16 23:05:57 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:58 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a" returned: 0 in 0.503s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:58 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:05:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:05:58 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (925ab971-168c-46ab-926b-bb782d79ed07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:58 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d3375d-5cb4-4411-a1c3-256aafcc6887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:05:58 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Volume volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a (13f7f8f6-42c1-43d0-8576-4ffb40cc678a): created successfully Apr 16 23:05:58 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49d3375d-5cb4-4411-a1c3-256aafcc6887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:05:58 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Flow 'volume_create_manager' (1773de5e-97b6-401a-8b47-4b77511b9ef0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:05:58 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-78925adc-3edc-4304-a1b0-bf59e7318d9e tempest-VolumesDeleteCascade-1763633411 None] Created volume successfully. Apr 16 23:05:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ef7cc7d1-729a-4e14-bca1-8e1958a038c6 tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:05:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ef7cc7d1-729a-4e14-bca1-8e1958a038c6 tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:05:58 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-ef7cc7d1-729a-4e14-bca1-8e1958a038c6 tempest-VolumesDeleteCascade-1763633411 None] Creating offline snapshot ba206b2f-52e0-419a-b66e-ed75712e106c of volume 13f7f8f6-42c1-43d0-8576-4ffb40cc678a {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:05:58 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83aa57d-bcad-43d3-9ce8-8e66a38299ea]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:05:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ef7cc7d1-729a-4e14-bca1-8e1958a038c6 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:59 devstack sudo[89536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a Apr 16 23:05:59 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:05:59 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root Apr 16 23:05:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ef7cc7d1-729a-4e14-bca1-8e1958a038c6 tempest-VolumesDeleteCascade-1763633411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a" returned: 0 in 0.606s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:05:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ef7cc7d1-729a-4e14-bca1-8e1958a038c6 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.ba206b2f-52e0-419a-b66e-ed75712e106c 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:05:59 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.ba206b2f-52e0-419a-b66e-ed75712e106c 1G Apr 16 23:05:59 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:00 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ef7cc7d1-729a-4e14-bca1-8e1958a038c6 tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.ba206b2f-52e0-419a-b66e-ed75712e106c 1G" returned: 0 in 0.531s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ef7cc7d1-729a-4e14-bca1-8e1958a038c6 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.ba206b2f-52e0-419a-b66e-ed75712e106c {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:00 devstack sudo[89580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.ba206b2f-52e0-419a-b66e-ed75712e106c Apr 16 23:06:00 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:00 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ef7cc7d1-729a-4e14-bca1-8e1958a038c6 tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.ba206b2f-52e0-419a-b66e-ed75712e106c" returned: 0 in 0.533s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:00 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-ef7cc7d1-729a-4e14-bca1-8e1958a038c6 tempest-VolumesDeleteCascade-1763633411 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.ba206b2f-52e0-419a-b66e-ed75712e106c is being set with open permissions: ugo+rw Apr 16 23:06:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ef7cc7d1-729a-4e14-bca1-8e1958a038c6 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.ba206b2f-52e0-419a-b66e-ed75712e106c {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:00 devstack sudo[89585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.ba206b2f-52e0-419a-b66e-ed75712e106c Apr 16 23:06:00 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:01 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ef7cc7d1-729a-4e14-bca1-8e1958a038c6 tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.ba206b2f-52e0-419a-b66e-ed75712e106c" returned: 0 in 0.547s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ef7cc7d1-729a-4e14-bca1-8e1958a038c6 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:01 devstack sudo[89588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.info Apr 16 23:06:01 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:01 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ef7cc7d1-729a-4e14-bca1-8e1958a038c6 tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.info" returned: 0 in 0.560s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:01 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-ef7cc7d1-729a-4e14-bca1-8e1958a038c6 tempest-VolumesDeleteCascade-1763633411 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.info is being set with open permissions: ugo+rw Apr 16 23:06:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ef7cc7d1-729a-4e14-bca1-8e1958a038c6 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:01 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.info Apr 16 23:06:01 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:02 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ef7cc7d1-729a-4e14-bca1-8e1958a038c6 tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.info" returned: 0 in 0.551s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ef7cc7d1-729a-4e14-bca1-8e1958a038c6 tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.402s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:06:02 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-ef7cc7d1-729a-4e14-bca1-8e1958a038c6 tempest-VolumesDeleteCascade-1763633411 None] Create snapshot completed successfully Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Flow 'volume_create_manager' (063004e9-4ae4-4f68-a641-b8480523d895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d21225-87a5-4388-8d2e-be9165f8d75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38d21225-87a5-4388-8d2e-be9165f8d75f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-398575535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a38f95c2-28fa-4a4f-9a95-11e79c660ed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29ae24c6bd414b23bc93e561545b3d74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ba206b2f-52e0-419a-b66e-ed75712e106c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:06:03Z,use_quota=True,user_id='b4909adffb4649f1ab62b83443d8a853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f92046-7758-4e53-bd3d-21424fdd2667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98f92046-7758-4e53-bd3d-21424fdd2667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141859d1-5fd5-4445-897e-c29066877410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141859d1-5fd5-4445-897e-c29066877410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a38f95c2-28fa-4a4f-9a95-11e79c660ed9', 'volume_name': 'volume-a38f95c2-28fa-4a4f-9a95-11e79c660ed9', 'volume_size': 1, 'snapshot_id': 'ba206b2f-52e0-419a-b66e-ed75712e106c'}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad9dc7da-2bb4-4804-8cda-7a05eeb65917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad9dc7da-2bb4-4804-8cda-7a05eeb65917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2967a934-247b-4835-b624-d3085db07712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:03 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Volume a38f95c2-28fa-4a4f-9a95-11e79c660ed9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a38f95c2-28fa-4a4f-9a95-11e79c660ed9', 'volume_size': 1, 'snapshot_id': 'ba206b2f-52e0-419a-b66e-ed75712e106c'} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "cinder-quobyte-ba206b2f-52e0-419a-b66e-ed75712e106c-a38f95c2-28fa-4a4f-9a95-11e79c660ed9" by "_create_volume_from_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-quobyte-ba206b2f-52e0-419a-b66e-ed75712e106c-a38f95c2-28fa-4a4f-9a95-11e79c660ed9" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Creating volume a38f95c2-28fa-4a4f-9a95-11e79c660ed9 from snapshot ba206b2f-52e0-419a-b66e-ed75712e106c {{(pid=81971) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "cinder-quobyte-a38f95c2-28fa-4a4f-9a95-11e79c660ed9" by "_copy_volume_from_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-quobyte-a38f95c2-28fa-4a4f-9a95-11e79c660ed9" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] snapshot: ba206b2f-52e0-419a-b66e-ed75712e106c, volume: a38f95c2-28fa-4a4f-9a95-11e79c660ed9, {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[a290e9e2-b8e2-4fe6-b5f0-00d3dbea1d66]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.ba206b2f-52e0-419a-b66e-ed75712e106c {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:03 devstack sudo[89595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.ba206b2f-52e0-419a-b66e-ed75712e106c Apr 16 23:06:03 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:03 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.ba206b2f-52e0-419a-b66e-ed75712e106c" returned: 0 in 0.467s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Creating direct copy from snapshot {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 23:06:03 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b4edda-59fa-4198-8ee9-b38e9175d513]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:06:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:04 devstack sudo[89600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a Apr 16 23:06:04 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:04 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a" returned: 0 in 0.540s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:04 devstack cinder-volume[81971]: DEBUG cinder.utils [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Path /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a38f95c2-28fa-4a4f-9a95-11e79c660ed9 not found in is_blk_device check {{(pid=81971) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 23:06:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a38f95c2-28fa-4a4f-9a95-11e79c660ed9 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:04 devstack sudo[89605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a38f95c2-28fa-4a4f-9a95-11e79c660ed9 Apr 16 23:06:04 devstack sudo[89605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:04 devstack cinder-volume[81971]: DEBUG oslo_service.periodic_task [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81971) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 23:06:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:06:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:06:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:06:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:06:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:06:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:04 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:06:04 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:05 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 1.049s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:05 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:06:07 devstack sudo[89605]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a38f95c2-28fa-4a4f-9a95-11e79c660ed9" returned: 0 in 2.859s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:07 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6017673-db89-49cf-a61e-2e7d53eab348]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:06:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:07 devstack sudo[89620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a Apr 16 23:06:07 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:08 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a" returned: 0 in 0.818s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:08 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Image conversion details: src /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a, size 1024.00 MB, duration 2.86 sec, destination /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a38f95c2-28fa-4a4f-9a95-11e79c660ed9 {{(pid=81971) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 23:06:08 devstack cinder-volume[81971]: INFO cinder.image.image_utils [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Converted 1024.00 MB image at 358.04 MB/s Apr 16 23:06:08 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a38f95c2-28fa-4a4f-9a95-11e79c660ed9 is being set with open permissions: ugo+rw Apr 16 23:06:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a38f95c2-28fa-4a4f-9a95-11e79c660ed9 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:08 devstack sudo[89625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a38f95c2-28fa-4a4f-9a95-11e79c660ed9 Apr 16 23:06:08 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:08 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a38f95c2-28fa-4a4f-9a95-11e79c660ed9" returned: 0 in 0.410s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:08 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-quobyte-a38f95c2-28fa-4a4f-9a95-11e79c660ed9" released by "_copy_volume_from_snapshot" :: held 5.150s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:06:08 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-quobyte-ba206b2f-52e0-419a-b66e-ed75712e106c-a38f95c2-28fa-4a4f-9a95-11e79c660ed9" released by "_create_volume_from_snapshot" :: held 5.169s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:06:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.176s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:06:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2967a934-247b-4835-b624-d3085db07712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a38f95c2-28fa-4a4f-9a95-11e79c660ed9', 'volume_size': 1, 'snapshot_id': 'ba206b2f-52e0-419a-b66e-ed75712e106c'}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec2f721-1619-47bc-9c6a-678e2c632ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:08 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Volume volume-a38f95c2-28fa-4a4f-9a95-11e79c660ed9 (a38f95c2-28fa-4a4f-9a95-11e79c660ed9): created successfully Apr 16 23:06:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec2f721-1619-47bc-9c6a-678e2c632ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Flow 'volume_create_manager' (063004e9-4ae4-4f68-a641-b8480523d895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:06:08 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-9d1ea10a-53b2-48fb-bfb4-b30f798de1a1 tempest-VolumesDeleteCascade-1763633411 None] Created volume successfully. Apr 16 23:06:08 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "cinder-13f7f8f6-42c1-43d0-8576-4ffb40cc678a-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:06:08 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-13f7f8f6-42c1-43d0-8576-4ffb40cc678a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:06:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Performing cascade delete. {{(pid=81971) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 16 23:06:08 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "cinder-ba206b2f-52e0-419a-b66e-ed75712e106c-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:06:08 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-ba206b2f-52e0-419a-b66e-ed75712e106c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:06:08 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "cinder-quobyte-13f7f8f6-42c1-43d0-8576-4ffb40cc678a" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:06:08 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-quobyte-13f7f8f6-42c1-43d0-8576-4ffb40cc678a" acquired by "delete_snapshot" :: waited 0.007s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:06:08 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "cinder-quobyte-ba206b2f-52e0-419a-b66e-ed75712e106c" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:06:08 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-quobyte-ba206b2f-52e0-419a-b66e-ed75712e106c" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:06:08 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Deleting offline snapshot ba206b2f-52e0-419a-b66e-ed75712e106c of volume 13f7f8f6-42c1-43d0-8576-4ffb40cc678a {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:06:08 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] snapshot_file for this snap is: volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.ba206b2f-52e0-419a-b66e-ed75712e106c {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:06:08 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64a4619-1def-4d9a-872a-1a31e3b459ee]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:06:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.ba206b2f-52e0-419a-b66e-ed75712e106c {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:09 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.ba206b2f-52e0-419a-b66e-ed75712e106c Apr 16 23:06:09 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:09 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.ba206b2f-52e0-419a-b66e-ed75712e106c" returned: 0 in 0.495s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:09 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:06:09 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4a66c6-b597-40c2-97b5-a40a5b235667]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:06:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:09 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a Apr 16 23:06:09 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:09 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a" returned: 0 in 0.481s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.ba206b2f-52e0-419a-b66e-ed75712e106c {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:09 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.ba206b2f-52e0-419a-b66e-ed75712e106c Apr 16 23:06:09 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:10 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.ba206b2f-52e0-419a-b66e-ed75712e106c" returned: 0 in 0.513s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.ba206b2f-52e0-419a-b66e-ed75712e106c {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:10 devstack sudo[89643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.ba206b2f-52e0-419a-b66e-ed75712e106c Apr 16 23:06:10 devstack sudo[89643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:10 devstack sudo[89643]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a.ba206b2f-52e0-419a-b66e-ed75712e106c" returned: 0 in 0.441s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:10 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-quobyte-ba206b2f-52e0-419a-b66e-ed75712e106c" released by "_delete_snapshot" :: held 1.981s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:06:10 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-quobyte-13f7f8f6-42c1-43d0-8576-4ffb40cc678a" released by "delete_snapshot" :: held 1.994s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:06:10 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Created reservations ['f993ae63-3ecd-49c7-97e8-083fa4a8192b', '2e597206-959f-422a-8519-44db08cea6e1', '6644ffc4-7468-4824-a0e4-f020f11daa91', 'a42acf7c-6c64-46b1-8df9-15689dbc5aff'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:06:11 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Delete snapshot completed successfully. Apr 16 23:06:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-ba206b2f-52e0-419a-b66e-ed75712e106c-delete_snapshot" released by "delete_snapshot" :: held 2.112s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:06:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Snapshots deleted, issuing volume delete {{(pid=81971) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 16 23:06:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "cinder-quobyte-13f7f8f6-42c1-43d0-8576-4ffb40cc678a" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:06:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-quobyte-13f7f8f6-42c1-43d0-8576-4ffb40cc678a" acquired by "delete_volume" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:06:11 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[272fe5ae-9228-4313-a5b5-9622624d7c8f]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:06:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:11 devstack sudo[89646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a Apr 16 23:06:11 devstack sudo[89646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:11 devstack sudo[89646]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a" returned: 0 in 0.555s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:11 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a Apr 16 23:06:11 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:12 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-13f7f8f6-42c1-43d0-8576-4ffb40cc678a" returned: 0 in 0.456s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:12 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-quobyte-13f7f8f6-42c1-43d0-8576-4ffb40cc678a" released by "delete_volume" :: held 1.044s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:06:12 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Created reservations ['0e960666-d35b-45fb-a4b7-d61a326bf5ed', '5b47c03f-ec0d-4a2c-ba0a-e9e89989ee8f', '92fb95a7-6444-424b-ab9c-783995a661be', 'f43e6082-9110-4e7f-b0c2-919bc3645f32'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:06:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:06:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:06:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:06:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:06:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:06:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:12 devstack sudo[89654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:06:12 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:12 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.477s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:12 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:06:12 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Deleted volume successfully. Apr 16 23:06:12 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5874425d-b68d-49de-9259-bc1b7767e4d5 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-13f7f8f6-42c1-43d0-8576-4ffb40cc678a-delete_volume" released by "delete_volume" :: held 3.802s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:06:13 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-356dced9-fb45-4a10-b898-77a44332a7e6 tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "cinder-a38f95c2-28fa-4a4f-9a95-11e79c660ed9-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:06:13 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-356dced9-fb45-4a10-b898-77a44332a7e6 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-a38f95c2-28fa-4a4f-9a95-11e79c660ed9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:06:13 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-356dced9-fb45-4a10-b898-77a44332a7e6 tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "cinder-quobyte-a38f95c2-28fa-4a4f-9a95-11e79c660ed9" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:06:13 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-356dced9-fb45-4a10-b898-77a44332a7e6 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-quobyte-a38f95c2-28fa-4a4f-9a95-11e79c660ed9" acquired by "delete_volume" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:06:13 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acb7fe7-15f6-4cc3-a863-ef50437f7a73]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:06:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-356dced9-fb45-4a10-b898-77a44332a7e6 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a38f95c2-28fa-4a4f-9a95-11e79c660ed9 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:13 devstack sudo[89659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a38f95c2-28fa-4a4f-9a95-11e79c660ed9 Apr 16 23:06:13 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:13 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-356dced9-fb45-4a10-b898-77a44332a7e6 tempest-VolumesDeleteCascade-1763633411 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a38f95c2-28fa-4a4f-9a95-11e79c660ed9" returned: 0 in 0.578s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-356dced9-fb45-4a10-b898-77a44332a7e6 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a38f95c2-28fa-4a4f-9a95-11e79c660ed9 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:13 devstack sudo[89664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a38f95c2-28fa-4a4f-9a95-11e79c660ed9 Apr 16 23:06:13 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:14 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-356dced9-fb45-4a10-b898-77a44332a7e6 tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a38f95c2-28fa-4a4f-9a95-11e79c660ed9" returned: 0 in 0.466s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-356dced9-fb45-4a10-b898-77a44332a7e6 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-quobyte-a38f95c2-28fa-4a4f-9a95-11e79c660ed9" released by "delete_volume" :: held 1.074s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:06:14 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-356dced9-fb45-4a10-b898-77a44332a7e6 tempest-VolumesDeleteCascade-1763633411 None] Created reservations ['bc9cf93f-2e70-460a-823e-4ff0d2ddfdbd', 'cc9e949a-79cd-44cb-bbdc-930a6f57f8e5', '34a0f7cc-88f3-407a-84be-550911f75102', 'c7749a66-362b-45b2-a68a-a20a403b5229'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:06:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-356dced9-fb45-4a10-b898-77a44332a7e6 tempest-VolumesDeleteCascade-1763633411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:06:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-356dced9-fb45-4a10-b898-77a44332a7e6 tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:06:14 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-356dced9-fb45-4a10-b898-77a44332a7e6 tempest-VolumesDeleteCascade-1763633411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:06:14 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-356dced9-fb45-4a10-b898-77a44332a7e6 tempest-VolumesDeleteCascade-1763633411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:06:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-356dced9-fb45-4a10-b898-77a44332a7e6 tempest-VolumesDeleteCascade-1763633411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:06:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-356dced9-fb45-4a10-b898-77a44332a7e6 tempest-VolumesDeleteCascade-1763633411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:14 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:06:14 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:14 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-356dced9-fb45-4a10-b898-77a44332a7e6 tempest-VolumesDeleteCascade-1763633411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.434s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:14 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-356dced9-fb45-4a10-b898-77a44332a7e6 tempest-VolumesDeleteCascade-1763633411 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:06:15 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-356dced9-fb45-4a10-b898-77a44332a7e6 tempest-VolumesDeleteCascade-1763633411 None] Deleted volume successfully. Apr 16 23:06:15 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-356dced9-fb45-4a10-b898-77a44332a7e6 tempest-VolumesDeleteCascade-1763633411 None] Lock "cinder-a38f95c2-28fa-4a4f-9a95-11e79c660ed9-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:06:19 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:06:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Flow 'volume_create_manager' (cc9634e1-318d-424a-bfca-50afa2d29aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:06:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f87d5b5-ef38-4405-b871-002ce0a4c584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f87d5b5-ef38-4405-b871-002ce0a4c584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1737846640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d10c2e-60d5-4c83-b059-93b728fe2fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4e634bfa174c46aca13d86e4d35f86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:06:19Z,use_quota=True,user_id='635006a66b8f49678b78325f06273514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e90c51-7491-4309-ad0c-4a2c069106c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e90c51-7491-4309-ad0c-4a2c069106c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dffebd3b-0fb5-411a-b99c-915631eb5a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dffebd3b-0fb5-411a-b99c-915631eb5a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65d10c2e-60d5-4c83-b059-93b728fe2fbe', 'volume_name': 'volume-65d10c2e-60d5-4c83-b059-93b728fe2fbe', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1391cdd6-3218-466a-ac58-c81a26ca1a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1391cdd6-3218-466a-ac58-c81a26ca1a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4347de-77e1-4287-abd6-af124641cabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:19 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Volume 65d10c2e-60d5-4c83-b059-93b728fe2fbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65d10c2e-60d5-4c83-b059-93b728fe2fbe', 'volume_size': 1} Apr 16 23:06:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:06:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:06:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1737846640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d10c2e-60d5-4c83-b059-93b728fe2fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4e634bfa174c46aca13d86e4d35f86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:06:19Z,use_quota=True,user_id='635006a66b8f49678b78325f06273514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:06:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Creating volume 65d10c2e-60d5-4c83-b059-93b728fe2fbe {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:06:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:06:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:06:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:06:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:06:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:06:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:06:19 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:06:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-65d10c2e-60d5-4c83-b059-93b728fe2fbe 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:19 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-65d10c2e-60d5-4c83-b059-93b728fe2fbe 1073741824 Apr 16 23:06:19 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:19 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-65d10c2e-60d5-4c83-b059-93b728fe2fbe 1073741824" returned: 0 in 0.654s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-65d10c2e-60d5-4c83-b059-93b728fe2fbe {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:19 devstack sudo[89676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-65d10c2e-60d5-4c83-b059-93b728fe2fbe Apr 16 23:06:19 devstack sudo[89676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:20 devstack sudo[89676]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-65d10c2e-60d5-4c83-b059-93b728fe2fbe" returned: 0 in 0.484s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:20 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:06:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:06:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e4347de-77e1-4287-abd6-af124641cabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65d10c2e-60d5-4c83-b059-93b728fe2fbe', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636db7d3-f8ee-4f8e-82eb-ddf044f463ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:20 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Volume volume-65d10c2e-60d5-4c83-b059-93b728fe2fbe (65d10c2e-60d5-4c83-b059-93b728fe2fbe): created successfully Apr 16 23:06:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (636db7d3-f8ee-4f8e-82eb-ddf044f463ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Flow 'volume_create_manager' (cc9634e1-318d-424a-bfca-50afa2d29aa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:06:20 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-0f6600d8-2627-417d-b734-d63b831fc48a tempest-VolumesTransfersV355Test-1964166192 None] Created volume successfully. Apr 16 23:06:21 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-52deb642-44c1-455b-b05e-5a1232de9715 tempest-VolumesTransfersV355Test-829837987 None] Transfer volume completed successfully. Apr 16 23:06:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d66ba2b2-6ff8-4224-bd27-2c033eac2b72 tempest-VolumesTransfersV355Test-1700870896 None] Acquiring lock "cinder-65d10c2e-60d5-4c83-b059-93b728fe2fbe-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:06:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d66ba2b2-6ff8-4224-bd27-2c033eac2b72 tempest-VolumesTransfersV355Test-1700870896 None] Lock "cinder-65d10c2e-60d5-4c83-b059-93b728fe2fbe-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:06:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d66ba2b2-6ff8-4224-bd27-2c033eac2b72 tempest-VolumesTransfersV355Test-1700870896 None] Acquiring lock "cinder-quobyte-65d10c2e-60d5-4c83-b059-93b728fe2fbe" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:06:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d66ba2b2-6ff8-4224-bd27-2c033eac2b72 tempest-VolumesTransfersV355Test-1700870896 None] Lock "cinder-quobyte-65d10c2e-60d5-4c83-b059-93b728fe2fbe" acquired by "delete_volume" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:06:22 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca1a292-0495-4062-8a37-ab398a97ebc4]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:06:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d66ba2b2-6ff8-4224-bd27-2c033eac2b72 tempest-VolumesTransfersV355Test-1700870896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-65d10c2e-60d5-4c83-b059-93b728fe2fbe {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:22 devstack sudo[89680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-65d10c2e-60d5-4c83-b059-93b728fe2fbe Apr 16 23:06:22 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:23 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d66ba2b2-6ff8-4224-bd27-2c033eac2b72 tempest-VolumesTransfersV355Test-1700870896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-65d10c2e-60d5-4c83-b059-93b728fe2fbe" returned: 0 in 0.545s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d66ba2b2-6ff8-4224-bd27-2c033eac2b72 tempest-VolumesTransfersV355Test-1700870896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-65d10c2e-60d5-4c83-b059-93b728fe2fbe {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:23 devstack sudo[89685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-65d10c2e-60d5-4c83-b059-93b728fe2fbe Apr 16 23:06:23 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:23 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d66ba2b2-6ff8-4224-bd27-2c033eac2b72 tempest-VolumesTransfersV355Test-1700870896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-65d10c2e-60d5-4c83-b059-93b728fe2fbe" returned: 0 in 0.455s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:23 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d66ba2b2-6ff8-4224-bd27-2c033eac2b72 tempest-VolumesTransfersV355Test-1700870896 None] Lock "cinder-quobyte-65d10c2e-60d5-4c83-b059-93b728fe2fbe" released by "delete_volume" :: held 1.023s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:06:23 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-d66ba2b2-6ff8-4224-bd27-2c033eac2b72 tempest-VolumesTransfersV355Test-1700870896 None] Created reservations ['de01b301-6da9-459e-89c1-60109f7fe361', '8ef06c14-6e34-4830-994d-cf83a738546f', '4766622a-e533-456a-aca1-69cad47beca8', '7e46c70a-b1b1-46de-806f-25f3bc065ebc'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:06:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d66ba2b2-6ff8-4224-bd27-2c033eac2b72 tempest-VolumesTransfersV355Test-1700870896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:06:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d66ba2b2-6ff8-4224-bd27-2c033eac2b72 tempest-VolumesTransfersV355Test-1700870896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:06:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d66ba2b2-6ff8-4224-bd27-2c033eac2b72 tempest-VolumesTransfersV355Test-1700870896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:06:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d66ba2b2-6ff8-4224-bd27-2c033eac2b72 tempest-VolumesTransfersV355Test-1700870896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:06:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d66ba2b2-6ff8-4224-bd27-2c033eac2b72 tempest-VolumesTransfersV355Test-1700870896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:06:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d66ba2b2-6ff8-4224-bd27-2c033eac2b72 tempest-VolumesTransfersV355Test-1700870896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:23 devstack sudo[89688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:06:23 devstack sudo[89688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:24 devstack sudo[89688]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d66ba2b2-6ff8-4224-bd27-2c033eac2b72 tempest-VolumesTransfersV355Test-1700870896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.435s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:24 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-d66ba2b2-6ff8-4224-bd27-2c033eac2b72 tempest-VolumesTransfersV355Test-1700870896 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:06:24 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-d66ba2b2-6ff8-4224-bd27-2c033eac2b72 tempest-VolumesTransfersV355Test-1700870896 None] Deleted volume successfully. Apr 16 23:06:24 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:SELECT=64,cinder:UPDATE=71,cinder:INSERT=25,cinder:DELETE=9 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 23:06:24 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d66ba2b2-6ff8-4224-bd27-2c033eac2b72 tempest-VolumesTransfersV355Test-1700870896 None] Lock "cinder-65d10c2e-60d5-4c83-b059-93b728fe2fbe-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:06:25 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:UPDATE=77,cinder:INSERT=13,cinder:DELETE=4,cinder:SELECT=59 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 23:06:25 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:06:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Flow 'volume_create_manager' (b04aaee7-fda6-4c5c-b06c-b73662cdaf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:06:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad9a9ab-3110-4984-8074-caaa3c14c330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad9a9ab-3110-4984-8074-caaa3c14c330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-814177306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd37534-3cc1-4d41-8859-254d65672125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4e634bfa174c46aca13d86e4d35f86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:06:25Z,use_quota=True,user_id='635006a66b8f49678b78325f06273514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a0bca9-77b4-4254-9dd3-5b19fbb74e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a0bca9-77b4-4254-9dd3-5b19fbb74e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c83d83-c859-425e-a735-f8cc0e7d75e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c83d83-c859-425e-a735-f8cc0e7d75e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fd37534-3cc1-4d41-8859-254d65672125', 'volume_name': 'volume-1fd37534-3cc1-4d41-8859-254d65672125', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd55a5f-d548-4dc4-924d-246f8aed36b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd55a5f-d548-4dc4-924d-246f8aed36b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:25 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dec4d10-bb1a-470f-8484-f42708b19845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:25 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Volume 1fd37534-3cc1-4d41-8859-254d65672125: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fd37534-3cc1-4d41-8859-254d65672125', 'volume_size': 1} Apr 16 23:06:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:06:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:06:25 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-814177306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fd37534-3cc1-4d41-8859-254d65672125,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4e634bfa174c46aca13d86e4d35f86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:06:25Z,use_quota=True,user_id='635006a66b8f49678b78325f06273514',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:06:25 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Creating volume 1fd37534-3cc1-4d41-8859-254d65672125 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:06:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:06:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:06:25 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:06:25 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:06:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:06:25 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:06:25 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:06:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fd37534-3cc1-4d41-8859-254d65672125 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:25 devstack sudo[89691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fd37534-3cc1-4d41-8859-254d65672125 1073741824 Apr 16 23:06:25 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:25 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fd37534-3cc1-4d41-8859-254d65672125 1073741824" returned: 0 in 0.597s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fd37534-3cc1-4d41-8859-254d65672125 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:25 devstack sudo[89696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fd37534-3cc1-4d41-8859-254d65672125 Apr 16 23:06:25 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:26 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fd37534-3cc1-4d41-8859-254d65672125" returned: 0 in 0.512s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:26 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:06:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:06:26 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dec4d10-bb1a-470f-8484-f42708b19845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fd37534-3cc1-4d41-8859-254d65672125', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:26 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62aa45dd-5f32-4902-b311-d85f748e1405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:26 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Volume volume-1fd37534-3cc1-4d41-8859-254d65672125 (1fd37534-3cc1-4d41-8859-254d65672125): created successfully Apr 16 23:06:26 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62aa45dd-5f32-4902-b311-d85f748e1405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:26 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Flow 'volume_create_manager' (b04aaee7-fda6-4c5c-b06c-b73662cdaf2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:06:26 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-d831b77d-a242-4f8a-8906-a666ba6cf029 tempest-VolumesTransfersV355Test-1964166192 None] Created volume successfully. Apr 16 23:06:27 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f180f5cc-2c85-4044-8074-587fcd25f6db tempest-VolumesTransfersV355Test-1700870896 None] Acquiring lock "cinder-1fd37534-3cc1-4d41-8859-254d65672125-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:06:27 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f180f5cc-2c85-4044-8074-587fcd25f6db tempest-VolumesTransfersV355Test-1700870896 None] Lock "cinder-1fd37534-3cc1-4d41-8859-254d65672125-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:06:27 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f180f5cc-2c85-4044-8074-587fcd25f6db tempest-VolumesTransfersV355Test-1700870896 None] Acquiring lock "cinder-quobyte-1fd37534-3cc1-4d41-8859-254d65672125" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:06:27 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f180f5cc-2c85-4044-8074-587fcd25f6db tempest-VolumesTransfersV355Test-1700870896 None] Lock "cinder-quobyte-1fd37534-3cc1-4d41-8859-254d65672125" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:06:27 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc95398-ca39-4f5f-b842-658742aa5997]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:06:27 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f180f5cc-2c85-4044-8074-587fcd25f6db tempest-VolumesTransfersV355Test-1700870896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fd37534-3cc1-4d41-8859-254d65672125 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:27 devstack sudo[89699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fd37534-3cc1-4d41-8859-254d65672125 Apr 16 23:06:27 devstack sudo[89699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:28 devstack sudo[89699]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f180f5cc-2c85-4044-8074-587fcd25f6db tempest-VolumesTransfersV355Test-1700870896 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fd37534-3cc1-4d41-8859-254d65672125" returned: 0 in 0.630s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f180f5cc-2c85-4044-8074-587fcd25f6db tempest-VolumesTransfersV355Test-1700870896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fd37534-3cc1-4d41-8859-254d65672125 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:28 devstack sudo[89704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fd37534-3cc1-4d41-8859-254d65672125 Apr 16 23:06:28 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:28 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f180f5cc-2c85-4044-8074-587fcd25f6db tempest-VolumesTransfersV355Test-1700870896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-1fd37534-3cc1-4d41-8859-254d65672125" returned: 0 in 0.594s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:28 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f180f5cc-2c85-4044-8074-587fcd25f6db tempest-VolumesTransfersV355Test-1700870896 None] Lock "cinder-quobyte-1fd37534-3cc1-4d41-8859-254d65672125" released by "delete_volume" :: held 1.254s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:06:28 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-f180f5cc-2c85-4044-8074-587fcd25f6db tempest-VolumesTransfersV355Test-1700870896 None] Created reservations ['0b5653a5-7411-4ab6-aeda-174518be3847', '51ab11e2-b6f4-4054-9eb5-53f1f58cc7e1', '2ded5e05-6067-46cf-b8c7-6cd4ae014da2', '76db2051-9c1a-477f-966d-d0644de164f1'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:06:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f180f5cc-2c85-4044-8074-587fcd25f6db tempest-VolumesTransfersV355Test-1700870896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:06:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f180f5cc-2c85-4044-8074-587fcd25f6db tempest-VolumesTransfersV355Test-1700870896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:06:28 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-f180f5cc-2c85-4044-8074-587fcd25f6db tempest-VolumesTransfersV355Test-1700870896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:06:28 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-f180f5cc-2c85-4044-8074-587fcd25f6db tempest-VolumesTransfersV355Test-1700870896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:06:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f180f5cc-2c85-4044-8074-587fcd25f6db tempest-VolumesTransfersV355Test-1700870896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:06:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f180f5cc-2c85-4044-8074-587fcd25f6db tempest-VolumesTransfersV355Test-1700870896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:28 devstack sudo[89707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:06:28 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:29 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f180f5cc-2c85-4044-8074-587fcd25f6db tempest-VolumesTransfersV355Test-1700870896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.539s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:29 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-f180f5cc-2c85-4044-8074-587fcd25f6db tempest-VolumesTransfersV355Test-1700870896 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:06:29 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-f180f5cc-2c85-4044-8074-587fcd25f6db tempest-VolumesTransfersV355Test-1700870896 None] Deleted volume successfully. Apr 16 23:06:29 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f180f5cc-2c85-4044-8074-587fcd25f6db tempest-VolumesTransfersV355Test-1700870896 None] Lock "cinder-1fd37534-3cc1-4d41-8859-254d65672125-delete_volume" released by "delete_volume" :: held 1.990s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:06:34 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:06:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Flow 'volume_create_manager' (3cd54eef-51bb-44a3-b6d7-d61eeacfb3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:06:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c37bf4-6344-40c7-b4ed-28a562e8357c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c37bf4-6344-40c7-b4ed-28a562e8357c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1757453884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1258247-99ef-4499-98cd-e2a8d59bc7a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e81587865834b9b8d5a3218cfaafa29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:06:34Z,use_quota=True,user_id='6ef4c1fd1af04e9f9e02ee2e87892dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3937e5f4-4a5d-46e2-b20d-3e7e32e708f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3937e5f4-4a5d-46e2-b20d-3e7e32e708f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0eb9174-d88b-4172-a301-fee75fcf7a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0eb9174-d88b-4172-a301-fee75fcf7a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1258247-99ef-4499-98cd-e2a8d59bc7a5', 'volume_name': 'volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5625db-cf55-4861-a7fb-0642578a75f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c5625db-cf55-4861-a7fb-0642578a75f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6f9f20-c5d1-4aab-a8b0-ff72e0c2945f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:34 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Volume f1258247-99ef-4499-98cd-e2a8d59bc7a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5', 'volume_size': 1} Apr 16 23:06:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:06:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:06:34 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1757453884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1258247-99ef-4499-98cd-e2a8d59bc7a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e81587865834b9b8d5a3218cfaafa29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:06:34Z,use_quota=True,user_id='6ef4c1fd1af04e9f9e02ee2e87892dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:06:34 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Creating volume f1258247-99ef-4499-98cd-e2a8d59bc7a5 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:06:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:06:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:06:34 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:06:34 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:06:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:06:34 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:06:34 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:06:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:34 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5 1073741824 Apr 16 23:06:34 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:34 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5 1073741824" returned: 0 in 0.536s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:34 devstack sudo[89717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5 Apr 16 23:06:34 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:35 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5" returned: 0 in 0.459s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:06:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:06:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf6f9f20-c5d1-4aab-a8b0-ff72e0c2945f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ffd1325-49e5-4e7b-89f1-6ef606fc68b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:35 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Volume volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5 (f1258247-99ef-4499-98cd-e2a8d59bc7a5): created successfully Apr 16 23:06:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ffd1325-49e5-4e7b-89f1-6ef606fc68b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Flow 'volume_create_manager' (3cd54eef-51bb-44a3-b6d7-d61eeacfb3d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:06:35 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-55609ce3-dc98-48bd-89d6-c9c2230d8926 tempest-VolumesCloneTest-1462283462 None] Created volume successfully. Apr 16 23:06:36 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:06:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Flow 'volume_create_manager' (41d9f390-9827-4c85-8f3c-f9c245f81f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:06:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c228aae-bcae-41d3-9565-c302cfeed419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c228aae-bcae-41d3-9565-c302cfeed419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:06:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1410093492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d0f8df-fa94-4274-9c3d-ec6c60b16b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e81587865834b9b8d5a3218cfaafa29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:06:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=f1258247-99ef-4499-98cd-e2a8d59bc7a5,status='creating',terminated_at=None,updated_at=2026-04-16T21:06:37Z,use_quota=True,user_id='6ef4c1fd1af04e9f9e02ee2e87892dfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32012924-fc70-4d82-8f41-97b930ac396b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32012924-fc70-4d82-8f41-97b930ac396b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0daf21-ddaa-4b24-93ea-402f6b7a86b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0daf21-ddaa-4b24-93ea-402f6b7a86b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd1d0f8df-fa94-4274-9c3d-ec6c60b16b48', 'volume_name': 'volume-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48', 'volume_size': 2, 'source_volid': 'f1258247-99ef-4499-98cd-e2a8d59bc7a5', 'source_volstatus': 'available'}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04f8c8a8-7dd0-4da0-9f2d-d1b975f03178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04f8c8a8-7dd0-4da0-9f2d-d1b975f03178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:36 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341f6b09-9b18-4f53-941c-7ed671573957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:36 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Volume d1d0f8df-fa94-4274-9c3d-ec6c60b16b48: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48', 'volume_size': 2, 'source_volid': 'f1258247-99ef-4499-98cd-e2a8d59bc7a5', 'source_volstatus': 'available'} Apr 16 23:06:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:06:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:06:36 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Cloning volume f1258247-99ef-4499-98cd-e2a8d59bc7a5 to volume d1d0f8df-fa94-4274-9c3d-ec6c60b16b48 Apr 16 23:06:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Creating offline snapshot 80669f0c-febe-4ee5-9e0a-693aba704fb3 of volume f1258247-99ef-4499-98cd-e2a8d59bc7a5 {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:06:36 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b246d2-d05a-4557-a556-cd48ad03530a]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:06:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:36 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5 Apr 16 23:06:36 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:37 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5" returned: 0 in 0.575s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.80669f0c-febe-4ee5-9e0a-693aba704fb3 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:37 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.80669f0c-febe-4ee5-9e0a-693aba704fb3 1G Apr 16 23:06:37 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:37 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.80669f0c-febe-4ee5-9e0a-693aba704fb3 1G" returned: 0 in 0.604s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.80669f0c-febe-4ee5-9e0a-693aba704fb3 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:37 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.80669f0c-febe-4ee5-9e0a-693aba704fb3 Apr 16 23:06:37 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:38 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.80669f0c-febe-4ee5-9e0a-693aba704fb3" returned: 0 in 0.554s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:38 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.80669f0c-febe-4ee5-9e0a-693aba704fb3 is being set with open permissions: ugo+rw Apr 16 23:06:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.80669f0c-febe-4ee5-9e0a-693aba704fb3 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:38 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.80669f0c-febe-4ee5-9e0a-693aba704fb3 Apr 16 23:06:38 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:39 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.80669f0c-febe-4ee5-9e0a-693aba704fb3" returned: 0 in 0.532s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:39 devstack sudo[89739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.info Apr 16 23:06:39 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:39 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.info" returned: 0 in 0.568s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:39 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.info is being set with open permissions: ugo+rw Apr 16 23:06:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:39 devstack sudo[89742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.info Apr 16 23:06:39 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:40 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.info" returned: 0 in 0.527s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:40 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Acquiring lock "cinder-quobyte-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48" by "_copy_volume_from_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:06:40 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Lock "cinder-quobyte-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:06:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] snapshot: 80669f0c-febe-4ee5-9e0a-693aba704fb3, volume: d1d0f8df-fa94-4274-9c3d-ec6c60b16b48, {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 23:06:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:06:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:06:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:06:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:06:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:06:40 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[6783899c-e4d6-4e82-8fdf-f9f72fbd3b16]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:06:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.80669f0c-febe-4ee5-9e0a-693aba704fb3 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:40 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.80669f0c-febe-4ee5-9e0a-693aba704fb3 Apr 16 23:06:40 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:40 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.80669f0c-febe-4ee5-9e0a-693aba704fb3" returned: 0 in 0.625s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:06:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5 {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 23:06:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Creating direct copy from snapshot {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 23:06:40 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea290b0-c887-4044-9a13-a9d82e8bde79]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:06:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:40 devstack sudo[89750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5 Apr 16 23:06:40 devstack sudo[89750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:41 devstack sudo[89750]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5" returned: 0 in 0.556s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:41 devstack cinder-volume[81971]: DEBUG cinder.utils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Path /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48 not found in is_blk_device check {{(pid=81971) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 23:06:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:41 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48 Apr 16 23:06:41 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:44 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48" returned: 0 in 2.727s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:44 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f05e4b-e2af-4178-87ad-34f0255b5ddc]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:06:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:44 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5 Apr 16 23:06:44 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:44 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5" returned: 0 in 0.735s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:44 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Image conversion details: src /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5, size 1024.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48 {{(pid=81971) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 23:06:44 devstack cinder-volume[81971]: INFO cinder.image.image_utils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Converted 1024.00 MB image at 375.25 MB/s Apr 16 23:06:44 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48 is being set with open permissions: ugo+rw Apr 16 23:06:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:44 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48 Apr 16 23:06:44 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:45 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48" returned: 0 in 0.568s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Lock "cinder-quobyte-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48" released by "_copy_volume_from_snapshot" :: held 5.273s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:06:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Acquiring lock "cinder-quobyte-80669f0c-febe-4ee5-9e0a-693aba704fb3" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:06:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Lock "cinder-quobyte-80669f0c-febe-4ee5-9e0a-693aba704fb3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:06:45 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Deleting offline snapshot 80669f0c-febe-4ee5-9e0a-693aba704fb3 of volume f1258247-99ef-4499-98cd-e2a8d59bc7a5 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:06:45 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] snapshot_file for this snap is: volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.80669f0c-febe-4ee5-9e0a-693aba704fb3 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:06:45 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cec804-2f4e-4494-ad55-4cd21375495f]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:06:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.80669f0c-febe-4ee5-9e0a-693aba704fb3 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:45 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.80669f0c-febe-4ee5-9e0a-693aba704fb3 Apr 16 23:06:45 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:46 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.80669f0c-febe-4ee5-9e0a-693aba704fb3" returned: 0 in 0.529s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:46 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:06:46 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[1636e5a2-e398-43fa-b234-c60773325b6f]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:06:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:46 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5 Apr 16 23:06:46 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:46 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5" returned: 0 in 0.599s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.80669f0c-febe-4ee5-9e0a-693aba704fb3 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:46 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.80669f0c-febe-4ee5-9e0a-693aba704fb3 Apr 16 23:06:46 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:47 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.80669f0c-febe-4ee5-9e0a-693aba704fb3" returned: 0 in 0.552s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.80669f0c-febe-4ee5-9e0a-693aba704fb3 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:47 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.80669f0c-febe-4ee5-9e0a-693aba704fb3 Apr 16 23:06:47 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:47 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5.80669f0c-febe-4ee5-9e0a-693aba704fb3" returned: 0 in 0.521s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:47 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Lock "cinder-quobyte-80669f0c-febe-4ee5-9e0a-693aba704fb3" released by "_delete_snapshot" :: held 2.260s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:06:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.046s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:06:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (341f6b09-9b18-4f53-941c-7ed671573957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48', 'volume_size': 2, 'source_volid': 'f1258247-99ef-4499-98cd-e2a8d59bc7a5', 'source_volstatus': 'available'}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d742cf18-b09a-4f75-a52a-f1d7c7c51802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:47 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Volume volume-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48 (d1d0f8df-fa94-4274-9c3d-ec6c60b16b48): created successfully Apr 16 23:06:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d742cf18-b09a-4f75-a52a-f1d7c7c51802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:47 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Flow 'volume_create_manager' (41d9f390-9827-4c85-8f3c-f9c245f81f78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:06:47 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-3bab2c25-150d-4c40-8fb1-9acaa1a6167f tempest-VolumesCloneTest-1462283462 None] Created volume successfully. Apr 16 23:06:48 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-965b237b-1503-4c05-b7b9-89ea145d6080 tempest-VolumesCloneTest-1462283462 None] Acquiring lock "cinder-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:06:48 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-965b237b-1503-4c05-b7b9-89ea145d6080 tempest-VolumesCloneTest-1462283462 None] Lock "cinder-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:06:48 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-965b237b-1503-4c05-b7b9-89ea145d6080 tempest-VolumesCloneTest-1462283462 None] Acquiring lock "cinder-quobyte-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:06:48 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-965b237b-1503-4c05-b7b9-89ea145d6080 tempest-VolumesCloneTest-1462283462 None] Lock "cinder-quobyte-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48" acquired by "delete_volume" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:06:48 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[80565037-e419-4c62-a78d-37869706308f]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:06:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-965b237b-1503-4c05-b7b9-89ea145d6080 tempest-VolumesCloneTest-1462283462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:48 devstack sudo[89800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48 Apr 16 23:06:48 devstack sudo[89800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:49 devstack sudo[89800]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-965b237b-1503-4c05-b7b9-89ea145d6080 tempest-VolumesCloneTest-1462283462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48" returned: 0 in 0.642s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-965b237b-1503-4c05-b7b9-89ea145d6080 tempest-VolumesCloneTest-1462283462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:49 devstack sudo[89805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48 Apr 16 23:06:49 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:49 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-965b237b-1503-4c05-b7b9-89ea145d6080 tempest-VolumesCloneTest-1462283462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48" returned: 0 in 0.566s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:49 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-965b237b-1503-4c05-b7b9-89ea145d6080 tempest-VolumesCloneTest-1462283462 None] Lock "cinder-quobyte-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48" released by "delete_volume" :: held 1.237s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:06:49 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-965b237b-1503-4c05-b7b9-89ea145d6080 tempest-VolumesCloneTest-1462283462 None] Created reservations ['254fda14-0542-486d-9f07-80b3ec7280b8', 'efdffb65-7e69-4c93-b70d-fd60a0bb9c6e', '55507bfc-2258-4308-98af-eeda0a9f5eaf', 'd9db444c-030f-40e8-b903-03d401c706e5'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:06:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-965b237b-1503-4c05-b7b9-89ea145d6080 tempest-VolumesCloneTest-1462283462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:06:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-965b237b-1503-4c05-b7b9-89ea145d6080 tempest-VolumesCloneTest-1462283462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:06:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-965b237b-1503-4c05-b7b9-89ea145d6080 tempest-VolumesCloneTest-1462283462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:06:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-965b237b-1503-4c05-b7b9-89ea145d6080 tempest-VolumesCloneTest-1462283462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:06:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-965b237b-1503-4c05-b7b9-89ea145d6080 tempest-VolumesCloneTest-1462283462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:06:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-965b237b-1503-4c05-b7b9-89ea145d6080 tempest-VolumesCloneTest-1462283462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:49 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:06:49 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:50 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-965b237b-1503-4c05-b7b9-89ea145d6080 tempest-VolumesCloneTest-1462283462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.491s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:50 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-965b237b-1503-4c05-b7b9-89ea145d6080 tempest-VolumesCloneTest-1462283462 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:06:50 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-965b237b-1503-4c05-b7b9-89ea145d6080 tempest-VolumesCloneTest-1462283462 None] Deleted volume successfully. Apr 16 23:06:50 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-965b237b-1503-4c05-b7b9-89ea145d6080 tempest-VolumesCloneTest-1462283462 None] Lock "cinder-d1d0f8df-fa94-4274-9c3d-ec6c60b16b48-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:06:50 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c267cdde-33e4-46b1-81cc-632429ad7b9a tempest-VolumesCloneTest-1462283462 None] Acquiring lock "cinder-f1258247-99ef-4499-98cd-e2a8d59bc7a5-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:06:50 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c267cdde-33e4-46b1-81cc-632429ad7b9a tempest-VolumesCloneTest-1462283462 None] Lock "cinder-f1258247-99ef-4499-98cd-e2a8d59bc7a5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:06:50 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c267cdde-33e4-46b1-81cc-632429ad7b9a tempest-VolumesCloneTest-1462283462 None] Acquiring lock "cinder-quobyte-f1258247-99ef-4499-98cd-e2a8d59bc7a5" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:06:50 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c267cdde-33e4-46b1-81cc-632429ad7b9a tempest-VolumesCloneTest-1462283462 None] Lock "cinder-quobyte-f1258247-99ef-4499-98cd-e2a8d59bc7a5" acquired by "delete_volume" :: waited 0.009s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:06:50 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[725c8189-ca93-479b-9524-413f2a461d9d]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:06:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c267cdde-33e4-46b1-81cc-632429ad7b9a tempest-VolumesCloneTest-1462283462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:50 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5 Apr 16 23:06:50 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:51 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c267cdde-33e4-46b1-81cc-632429ad7b9a tempest-VolumesCloneTest-1462283462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5" returned: 0 in 0.584s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c267cdde-33e4-46b1-81cc-632429ad7b9a tempest-VolumesCloneTest-1462283462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:51 devstack sudo[89816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5 Apr 16 23:06:51 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:51 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c267cdde-33e4-46b1-81cc-632429ad7b9a tempest-VolumesCloneTest-1462283462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-f1258247-99ef-4499-98cd-e2a8d59bc7a5" returned: 0 in 0.562s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:51 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c267cdde-33e4-46b1-81cc-632429ad7b9a tempest-VolumesCloneTest-1462283462 None] Lock "cinder-quobyte-f1258247-99ef-4499-98cd-e2a8d59bc7a5" released by "delete_volume" :: held 1.195s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:06:52 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-c267cdde-33e4-46b1-81cc-632429ad7b9a tempest-VolumesCloneTest-1462283462 None] Created reservations ['b0e9dcf6-3af2-4173-ba25-723494d34214', '3ce7f52b-9abd-4aa7-b47e-a50b5d7b0caf', '1a37a02a-1020-4538-b1ac-02ff726bb80c', '7d5ecb89-b16b-4b80-a6e7-78853fe73b6d'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:06:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c267cdde-33e4-46b1-81cc-632429ad7b9a tempest-VolumesCloneTest-1462283462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:06:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c267cdde-33e4-46b1-81cc-632429ad7b9a tempest-VolumesCloneTest-1462283462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:06:52 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c267cdde-33e4-46b1-81cc-632429ad7b9a tempest-VolumesCloneTest-1462283462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:06:52 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c267cdde-33e4-46b1-81cc-632429ad7b9a tempest-VolumesCloneTest-1462283462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:06:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c267cdde-33e4-46b1-81cc-632429ad7b9a tempest-VolumesCloneTest-1462283462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:06:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c267cdde-33e4-46b1-81cc-632429ad7b9a tempest-VolumesCloneTest-1462283462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:52 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:06:52 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:52 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c267cdde-33e4-46b1-81cc-632429ad7b9a tempest-VolumesCloneTest-1462283462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.484s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:52 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-c267cdde-33e4-46b1-81cc-632429ad7b9a tempest-VolumesCloneTest-1462283462 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:06:52 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-c267cdde-33e4-46b1-81cc-632429ad7b9a tempest-VolumesCloneTest-1462283462 None] Deleted volume successfully. Apr 16 23:06:52 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c267cdde-33e4-46b1-81cc-632429ad7b9a tempest-VolumesCloneTest-1462283462 None] Lock "cinder-f1258247-99ef-4499-98cd-e2a8d59bc7a5-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:06:56 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:06:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Flow 'volume_create_manager' (c3beeee1-2c10-4499-8d17-92be28d67566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:06:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd54ae6-e7d2-4429-9271-cc205972f116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbd54ae6-e7d2-4429-9271-cc205972f116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1052426708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26282f9e-0230-4d53-8999-eb06fa612cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173bf2647acd4a2db9f602026bb716d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:06:57Z,use_quota=True,user_id='f452cc8ec5544da9bca2e808791f7356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c508b200-6028-44f5-acf6-001befc0f2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c508b200-6028-44f5-acf6-001befc0f2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a86cc18-6794-4f48-959d-dbebff5a704f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a86cc18-6794-4f48-959d-dbebff5a704f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26282f9e-0230-4d53-8999-eb06fa612cfc', 'volume_name': 'volume-26282f9e-0230-4d53-8999-eb06fa612cfc', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9899d97c-f778-410c-8b78-4743ac905db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9899d97c-f778-410c-8b78-4743ac905db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0bdec1-9e59-46e2-b986-0c52d769e1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:56 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Volume 26282f9e-0230-4d53-8999-eb06fa612cfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26282f9e-0230-4d53-8999-eb06fa612cfc', 'volume_size': 1} Apr 16 23:06:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:06:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:06:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1052426708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26282f9e-0230-4d53-8999-eb06fa612cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173bf2647acd4a2db9f602026bb716d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:06:57Z,use_quota=True,user_id='f452cc8ec5544da9bca2e808791f7356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:06:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Creating volume 26282f9e-0230-4d53-8999-eb06fa612cfc {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:06:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:06:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:06:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:06:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:06:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:06:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:06:56 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:06:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:56 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc 1073741824 Apr 16 23:06:56 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:57 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc 1073741824" returned: 0 in 0.475s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:57 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc Apr 16 23:06:57 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:57 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc" returned: 0 in 0.417s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:06:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:06:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc0bdec1-9e59-46e2-b986-0c52d769e1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26282f9e-0230-4d53-8999-eb06fa612cfc', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc3851be-59aa-4c67-ab84-a959ad07dbb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:06:57 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Volume volume-26282f9e-0230-4d53-8999-eb06fa612cfc (26282f9e-0230-4d53-8999-eb06fa612cfc): created successfully Apr 16 23:06:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc3851be-59aa-4c67-ab84-a959ad07dbb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:06:57 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Flow 'volume_create_manager' (c3beeee1-2c10-4499-8d17-92be28d67566) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:06:57 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-5006aab2-c9c7-4e50-b52b-b04a0f474cc8 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Created volume successfully. Apr 16 23:06:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a3ae6b88-7e84-4075-ba46-bd07e901e4c2 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:06:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a3ae6b88-7e84-4075-ba46-bd07e901e4c2 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:06:59 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-a3ae6b88-7e84-4075-ba46-bd07e901e4c2 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Creating offline snapshot d6efb45b-818d-43b0-9820-7049500e85d3 of volume 26282f9e-0230-4d53-8999-eb06fa612cfc {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:06:59 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d11f377-50d0-428a-89e6-f120c21b832c]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:06:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a3ae6b88-7e84-4075-ba46-bd07e901e4c2 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:59 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc Apr 16 23:06:59 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:06:59 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Apr 16 23:06:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a3ae6b88-7e84-4075-ba46-bd07e901e4c2 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc" returned: 0 in 0.554s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:06:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a3ae6b88-7e84-4075-ba46-bd07e901e4c2 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.d6efb45b-818d-43b0-9820-7049500e85d3 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:06:59 devstack sudo[89838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.d6efb45b-818d-43b0-9820-7049500e85d3 1G Apr 16 23:06:59 devstack sudo[89838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:00 devstack sudo[89838]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a3ae6b88-7e84-4075-ba46-bd07e901e4c2 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.d6efb45b-818d-43b0-9820-7049500e85d3 1G" returned: 0 in 0.560s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a3ae6b88-7e84-4075-ba46-bd07e901e4c2 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26282f9e-0230-4d53-8999-eb06fa612cfc -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.d6efb45b-818d-43b0-9820-7049500e85d3 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:00 devstack sudo[89875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26282f9e-0230-4d53-8999-eb06fa612cfc -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.d6efb45b-818d-43b0-9820-7049500e85d3 Apr 16 23:07:00 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:00 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a3ae6b88-7e84-4075-ba46-bd07e901e4c2 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26282f9e-0230-4d53-8999-eb06fa612cfc -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.d6efb45b-818d-43b0-9820-7049500e85d3" returned: 0 in 0.473s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:00 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-a3ae6b88-7e84-4075-ba46-bd07e901e4c2 tempest-CreateVolumesFromSnapshotTest-1207665203 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.d6efb45b-818d-43b0-9820-7049500e85d3 is being set with open permissions: ugo+rw Apr 16 23:07:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a3ae6b88-7e84-4075-ba46-bd07e901e4c2 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.d6efb45b-818d-43b0-9820-7049500e85d3 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:00 devstack sudo[89882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.d6efb45b-818d-43b0-9820-7049500e85d3 Apr 16 23:07:00 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:01 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a3ae6b88-7e84-4075-ba46-bd07e901e4c2 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.d6efb45b-818d-43b0-9820-7049500e85d3" returned: 0 in 0.454s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a3ae6b88-7e84-4075-ba46-bd07e901e4c2 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:01 devstack sudo[89885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.info Apr 16 23:07:01 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:01 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a3ae6b88-7e84-4075-ba46-bd07e901e4c2 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.info" returned: 0 in 0.497s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:01 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-a3ae6b88-7e84-4075-ba46-bd07e901e4c2 tempest-CreateVolumesFromSnapshotTest-1207665203 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.info is being set with open permissions: ugo+rw Apr 16 23:07:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a3ae6b88-7e84-4075-ba46-bd07e901e4c2 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:01 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.info Apr 16 23:07:01 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:02 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a3ae6b88-7e84-4075-ba46-bd07e901e4c2 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.info" returned: 0 in 0.466s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a3ae6b88-7e84-4075-ba46-bd07e901e4c2 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.113s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:02 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-a3ae6b88-7e84-4075-ba46-bd07e901e4c2 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Create snapshot completed successfully Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Flow 'volume_create_manager' (c3b41ab3-8eba-4021-8445-a568e21ed12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7357d959-a886-41e1-8894-15d8caba345b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7357d959-a886-41e1-8894-15d8caba345b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-676776181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef929c4-be71-4f18-b732-770e50de065b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173bf2647acd4a2db9f602026bb716d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:03Z,use_quota=True,user_id='f452cc8ec5544da9bca2e808791f7356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c16f29b4-3102-4619-b41a-8a7a9436459a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c16f29b4-3102-4619-b41a-8a7a9436459a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1092fc-7976-4476-89f7-07062957f881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1092fc-7976-4476-89f7-07062957f881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aef929c4-be71-4f18-b732-770e50de065b', 'volume_name': 'volume-aef929c4-be71-4f18-b732-770e50de065b', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0afb44d-96da-4e55-b26c-4508dd2778de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0afb44d-96da-4e55-b26c-4508dd2778de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc886d4-d198-4bfa-b639-06c06a5a016a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:03 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Volume aef929c4-be71-4f18-b732-770e50de065b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aef929c4-be71-4f18-b732-770e50de065b', 'volume_size': 1} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-676776181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef929c4-be71-4f18-b732-770e50de065b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173bf2647acd4a2db9f602026bb716d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:03Z,use_quota=True,user_id='f452cc8ec5544da9bca2e808791f7356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Creating volume aef929c4-be71-4f18-b732-770e50de065b {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:07:03 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-aef929c4-be71-4f18-b732-770e50de065b 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:03 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-aef929c4-be71-4f18-b732-770e50de065b 1073741824 Apr 16 23:07:03 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Flow 'volume_create_manager' (61033f78-7aba-48bf-b579-a8938491b20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6746b903-4535-4fd2-a7d5-768b49299362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6746b903-4535-4fd2-a7d5-768b49299362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2111552481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d86120-2254-4d67-a311-9e22c974ed2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173bf2647acd4a2db9f602026bb716d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:04Z,use_quota=True,user_id='f452cc8ec5544da9bca2e808791f7356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c946e437-7323-4a82-8c10-31f46438cfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c946e437-7323-4a82-8c10-31f46438cfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb338281-86a9-48f8-9e47-6270638f3957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb338281-86a9-48f8-9e47-6270638f3957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28d86120-2254-4d67-a311-9e22c974ed2b', 'volume_name': 'volume-28d86120-2254-4d67-a311-9e22c974ed2b', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a183cfd8-0a67-4a7b-9925-089e1bd69da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a183cfd8-0a67-4a7b-9925-089e1bd69da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e98fbf-9033-48c1-9b61-7ecaa89001aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:03 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Volume 28d86120-2254-4d67-a311-9e22c974ed2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28d86120-2254-4d67-a311-9e22c974ed2b', 'volume_size': 1} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Flow 'volume_create_manager' (5e3154be-d28e-41ad-ad66-15da5aa2c5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e45a3c3-903a-4b89-b421-854a891f02c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e45a3c3-903a-4b89-b421-854a891f02c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1888012489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e6a39e-8bc6-4108-92df-b51f270dd39d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173bf2647acd4a2db9f602026bb716d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:04Z,use_quota=True,user_id='f452cc8ec5544da9bca2e808791f7356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38529fd8-3a30-426c-9543-df0d81023e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38529fd8-3a30-426c-9543-df0d81023e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37138b9a-ed64-4da3-ae6b-e7cfe95d7c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37138b9a-ed64-4da3-ae6b-e7cfe95d7c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41e6a39e-8bc6-4108-92df-b51f270dd39d', 'volume_name': 'volume-41e6a39e-8bc6-4108-92df-b51f270dd39d', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5e0c03-93b9-4115-8656-b6df34c5b601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd5e0c03-93b9-4115-8656-b6df34c5b601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4c042f-97fc-468e-9e1c-638ff19e5e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:03 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Volume 41e6a39e-8bc6-4108-92df-b51f270dd39d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41e6a39e-8bc6-4108-92df-b51f270dd39d', 'volume_size': 1} Apr 16 23:07:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Flow 'volume_create_manager' (81e3ea3c-b2a4-4065-8a27-406ca4c1ac4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f17f0930-14ff-430d-94c9-e758d0c5d10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f17f0930-14ff-430d-94c9-e758d0c5d10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1900980104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05aac35a-3139-48e5-a525-0d5875868e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173bf2647acd4a2db9f602026bb716d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:04Z,use_quota=True,user_id='f452cc8ec5544da9bca2e808791f7356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03c6ba2-61ce-4681-a49b-d42db88e7c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03c6ba2-61ce-4681-a49b-d42db88e7c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d79c7b81-8973-48ce-afce-9ea94bf6b377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d79c7b81-8973-48ce-afce-9ea94bf6b377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05aac35a-3139-48e5-a525-0d5875868e8c', 'volume_name': 'volume-05aac35a-3139-48e5-a525-0d5875868e8c', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:04 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe3be46-4f0b-43f2-9935-c7e4e075a5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe3be46-4f0b-43f2-9935-c7e4e075a5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca8b4f0-6770-4488-9e27-332c07646d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:04 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Volume 05aac35a-3139-48e5-a525-0d5875868e8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05aac35a-3139-48e5-a525-0d5875868e8c', 'volume_size': 1} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-aef929c4-be71-4f18-b732-770e50de065b 1073741824" returned: 0 in 0.707s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-aef929c4-be71-4f18-b732-770e50de065b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:04 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-aef929c4-be71-4f18-b732-770e50de065b Apr 16 23:07:04 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Flow 'volume_create_manager' (ed633bba-d018-4974-a20d-7cd44ab5a03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1630df6-c5f9-41bd-9a2a-7993c2178f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1630df6-c5f9-41bd-9a2a-7993c2178f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1161477560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab25b1c6-7d87-4593-86d8-2d96f3495991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173bf2647acd4a2db9f602026bb716d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:04Z,use_quota=True,user_id='f452cc8ec5544da9bca2e808791f7356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77495b0-7638-4de4-93e5-8750ad91c3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77495b0-7638-4de4-93e5-8750ad91c3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3afd80aa-02c8-47cd-a98c-20c3f874edaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3afd80aa-02c8-47cd-a98c-20c3f874edaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab25b1c6-7d87-4593-86d8-2d96f3495991', 'volume_name': 'volume-ab25b1c6-7d87-4593-86d8-2d96f3495991', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a56f8a69-e26e-4fe9-9255-9b5b236958b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a56f8a69-e26e-4fe9-9255-9b5b236958b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3afdb8e6-2fd7-47ac-a411-0bf42d9b6009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:04 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Volume ab25b1c6-7d87-4593-86d8-2d96f3495991: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab25b1c6-7d87-4593-86d8-2d96f3495991', 'volume_size': 1} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:04 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-aef929c4-be71-4f18-b732-770e50de065b" returned: 0 in 0.500s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2111552481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d86120-2254-4d67-a311-9e22c974ed2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173bf2647acd4a2db9f602026bb716d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:04Z,use_quota=True,user_id='f452cc8ec5544da9bca2e808791f7356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Creating volume 28d86120-2254-4d67-a311-9e22c974ed2b {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:07:04 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-28d86120-2254-4d67-a311-9e22c974ed2b 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bc886d4-d198-4bfa-b639-06c06a5a016a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aef929c4-be71-4f18-b732-770e50de065b', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5541f40e-fcba-4d09-bcbe-2f65d98ac6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:04 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-28d86120-2254-4d67-a311-9e22c974ed2b 1073741824 Apr 16 23:07:04 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:04 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Volume volume-aef929c4-be71-4f18-b732-770e50de065b (aef929c4-be71-4f18-b732-770e50de065b): created successfully Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5541f40e-fcba-4d09-bcbe-2f65d98ac6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Flow 'volume_create_manager' (c3b41ab3-8eba-4021-8445-a568e21ed12f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:04 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-d46d006c-fe57-4576-a1d8-919f5c94e3a0 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Created volume successfully. Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG oslo_service.periodic_task [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81971) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:04 devstack sudo[89902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:07:04 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:05 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-28d86120-2254-4d67-a311-9e22c974ed2b 1073741824" returned: 0 in 0.854s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-28d86120-2254-4d67-a311-9e22c974ed2b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:05 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-28d86120-2254-4d67-a311-9e22c974ed2b Apr 16 23:07:05 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:05 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.807s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:05 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:07:06 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-28d86120-2254-4d67-a311-9e22c974ed2b" returned: 0 in 0.576s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:07:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.258s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1888012489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e6a39e-8bc6-4108-92df-b51f270dd39d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173bf2647acd4a2db9f602026bb716d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:04Z,use_quota=True,user_id='f452cc8ec5544da9bca2e808791f7356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:07:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Creating volume 41e6a39e-8bc6-4108-92df-b51f270dd39d {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:07:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:07:06 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:07:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-41e6a39e-8bc6-4108-92df-b51f270dd39d 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:06 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e98fbf-9033-48c1-9b61-7ecaa89001aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28d86120-2254-4d67-a311-9e22c974ed2b', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:06 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e13dfe17-7c13-43f3-803f-9072401bbabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:06 devstack sudo[89911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-41e6a39e-8bc6-4108-92df-b51f270dd39d 1073741824 Apr 16 23:07:06 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:06 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Volume volume-28d86120-2254-4d67-a311-9e22c974ed2b (28d86120-2254-4d67-a311-9e22c974ed2b): created successfully Apr 16 23:07:06 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e13dfe17-7c13-43f3-803f-9072401bbabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:06 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Flow 'volume_create_manager' (61033f78-7aba-48bf-b579-a8938491b20d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:06 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-89b4fa40-c147-4d04-b1ba-7765b196fea5 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Created volume successfully. Apr 16 23:07:06 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-41e6a39e-8bc6-4108-92df-b51f270dd39d 1073741824" returned: 0 in 0.662s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-41e6a39e-8bc6-4108-92df-b51f270dd39d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:06 devstack sudo[89916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-41e6a39e-8bc6-4108-92df-b51f270dd39d Apr 16 23:07:06 devstack sudo[89916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:07 devstack sudo[89916]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-41e6a39e-8bc6-4108-92df-b51f270dd39d" returned: 0 in 0.438s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:07:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.142s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1900980104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05aac35a-3139-48e5-a525-0d5875868e8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173bf2647acd4a2db9f602026bb716d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:04Z,use_quota=True,user_id='f452cc8ec5544da9bca2e808791f7356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:07:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Creating volume 05aac35a-3139-48e5-a525-0d5875868e8c {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:07:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:07:07 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:07:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-05aac35a-3139-48e5-a525-0d5875868e8c 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:07 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b4c042f-97fc-468e-9e1c-638ff19e5e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41e6a39e-8bc6-4108-92df-b51f270dd39d', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:07 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-05aac35a-3139-48e5-a525-0d5875868e8c 1073741824 Apr 16 23:07:07 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:07 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1addb901-e807-4a7e-943a-8fb44876cfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:07 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Volume volume-41e6a39e-8bc6-4108-92df-b51f270dd39d (41e6a39e-8bc6-4108-92df-b51f270dd39d): created successfully Apr 16 23:07:07 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1addb901-e807-4a7e-943a-8fb44876cfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:07 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Flow 'volume_create_manager' (5e3154be-d28e-41ad-ad66-15da5aa2c5d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:07 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-95d01eb4-2853-4e57-a806-5d58c1564e0d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Created volume successfully. Apr 16 23:07:07 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-05aac35a-3139-48e5-a525-0d5875868e8c 1073741824" returned: 0 in 0.577s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-05aac35a-3139-48e5-a525-0d5875868e8c {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:07 devstack sudo[89924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-05aac35a-3139-48e5-a525-0d5875868e8c Apr 16 23:07:07 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:08 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-05aac35a-3139-48e5-a525-0d5875868e8c" returned: 0 in 0.444s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:08 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:07:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.932s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:08 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1161477560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab25b1c6-7d87-4593-86d8-2d96f3495991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173bf2647acd4a2db9f602026bb716d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:04Z,use_quota=True,user_id='f452cc8ec5544da9bca2e808791f7356',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:07:08 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Creating volume ab25b1c6-7d87-4593-86d8-2d96f3495991 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:07:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:08 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:08 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:08 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:07:08 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:07:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ab25b1c6-7d87-4593-86d8-2d96f3495991 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dca8b4f0-6770-4488-9e27-332c07646d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05aac35a-3139-48e5-a525-0d5875868e8c', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:08 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ab25b1c6-7d87-4593-86d8-2d96f3495991 1073741824 Apr 16 23:07:08 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9efc311-c789-4d12-a3b0-ace233822199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:08 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Volume volume-05aac35a-3139-48e5-a525-0d5875868e8c (05aac35a-3139-48e5-a525-0d5875868e8c): created successfully Apr 16 23:07:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9efc311-c789-4d12-a3b0-ace233822199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Flow 'volume_create_manager' (81e3ea3c-b2a4-4065-8a27-406ca4c1ac4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:08 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-59ced3cd-d825-4592-9163-c494e1a94a9d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Created volume successfully. Apr 16 23:07:08 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ab25b1c6-7d87-4593-86d8-2d96f3495991 1073741824" returned: 0 in 0.609s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ab25b1c6-7d87-4593-86d8-2d96f3495991 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:09 devstack sudo[89932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ab25b1c6-7d87-4593-86d8-2d96f3495991 Apr 16 23:07:09 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:09 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ab25b1c6-7d87-4593-86d8-2d96f3495991" returned: 0 in 0.468s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:09 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:07:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3afdb8e6-2fd7-47ac-a411-0bf42d9b6009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab25b1c6-7d87-4593-86d8-2d96f3495991', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9721d856-e3c4-4f52-ba62-8b54eab7bb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:09 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Volume volume-ab25b1c6-7d87-4593-86d8-2d96f3495991 (ab25b1c6-7d87-4593-86d8-2d96f3495991): created successfully Apr 16 23:07:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9721d856-e3c4-4f52-ba62-8b54eab7bb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Flow 'volume_create_manager' (ed633bba-d018-4974-a20d-7cd44ab5a03d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:09 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-c5187bbc-7996-4aeb-b9f3-44242e70cbe9 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Created volume successfully. Apr 16 23:07:09 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-075d5717-236f-4be6-926c-4b6263f461a4 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "cinder-ab25b1c6-7d87-4593-86d8-2d96f3495991-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:09 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-075d5717-236f-4be6-926c-4b6263f461a4 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-ab25b1c6-7d87-4593-86d8-2d96f3495991-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:10 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-075d5717-236f-4be6-926c-4b6263f461a4 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "cinder-quobyte-ab25b1c6-7d87-4593-86d8-2d96f3495991" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:10 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-075d5717-236f-4be6-926c-4b6263f461a4 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-quobyte-ab25b1c6-7d87-4593-86d8-2d96f3495991" acquired by "delete_volume" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:10 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9791a0-4319-4fea-b822-f5fbc34d695b]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:07:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-075d5717-236f-4be6-926c-4b6263f461a4 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ab25b1c6-7d87-4593-86d8-2d96f3495991 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:10 devstack sudo[89935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ab25b1c6-7d87-4593-86d8-2d96f3495991 Apr 16 23:07:10 devstack sudo[89935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:10 devstack sudo[89935]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-075d5717-236f-4be6-926c-4b6263f461a4 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ab25b1c6-7d87-4593-86d8-2d96f3495991" returned: 0 in 0.551s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-075d5717-236f-4be6-926c-4b6263f461a4 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ab25b1c6-7d87-4593-86d8-2d96f3495991 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:10 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ab25b1c6-7d87-4593-86d8-2d96f3495991 Apr 16 23:07:10 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:11 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-075d5717-236f-4be6-926c-4b6263f461a4 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ab25b1c6-7d87-4593-86d8-2d96f3495991" returned: 0 in 0.557s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-075d5717-236f-4be6-926c-4b6263f461a4 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-quobyte-ab25b1c6-7d87-4593-86d8-2d96f3495991" released by "delete_volume" :: held 1.139s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:11 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-075d5717-236f-4be6-926c-4b6263f461a4 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Created reservations ['e45d3365-7429-4c63-85ac-0fd709b6e780', '8ebcbf22-39af-49ea-91e5-7a6b59eb1b11', 'c0f3f5b4-0afc-4e43-bd6f-d275f00b13d8', 'ee000493-a760-4343-91e1-ed08807b2509'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:07:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-075d5717-236f-4be6-926c-4b6263f461a4 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-075d5717-236f-4be6-926c-4b6263f461a4 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-075d5717-236f-4be6-926c-4b6263f461a4 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-075d5717-236f-4be6-926c-4b6263f461a4 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-075d5717-236f-4be6-926c-4b6263f461a4 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-075d5717-236f-4be6-926c-4b6263f461a4 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:11 devstack sudo[89943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:07:11 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:11 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-075d5717-236f-4be6-926c-4b6263f461a4 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.531s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:11 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-075d5717-236f-4be6-926c-4b6263f461a4 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:07:11 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-075d5717-236f-4be6-926c-4b6263f461a4 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Deleted volume successfully. Apr 16 23:07:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-075d5717-236f-4be6-926c-4b6263f461a4 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-ab25b1c6-7d87-4593-86d8-2d96f3495991-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:12 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-03fe4635-b746-4f2a-8c9b-b4bc09b3a62d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "cinder-05aac35a-3139-48e5-a525-0d5875868e8c-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:12 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-03fe4635-b746-4f2a-8c9b-b4bc09b3a62d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-05aac35a-3139-48e5-a525-0d5875868e8c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:12 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-03fe4635-b746-4f2a-8c9b-b4bc09b3a62d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "cinder-quobyte-05aac35a-3139-48e5-a525-0d5875868e8c" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:12 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-03fe4635-b746-4f2a-8c9b-b4bc09b3a62d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-quobyte-05aac35a-3139-48e5-a525-0d5875868e8c" acquired by "delete_volume" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:12 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[20509e77-463d-4cf1-92b9-d72882aed59e]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:07:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-03fe4635-b746-4f2a-8c9b-b4bc09b3a62d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-05aac35a-3139-48e5-a525-0d5875868e8c {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:12 devstack sudo[89947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-05aac35a-3139-48e5-a525-0d5875868e8c Apr 16 23:07:12 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:12 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-03fe4635-b746-4f2a-8c9b-b4bc09b3a62d tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-05aac35a-3139-48e5-a525-0d5875868e8c" returned: 0 in 0.588s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-03fe4635-b746-4f2a-8c9b-b4bc09b3a62d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-05aac35a-3139-48e5-a525-0d5875868e8c {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:12 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-05aac35a-3139-48e5-a525-0d5875868e8c Apr 16 23:07:12 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:13 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-03fe4635-b746-4f2a-8c9b-b4bc09b3a62d tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-05aac35a-3139-48e5-a525-0d5875868e8c" returned: 0 in 0.440s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:13 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-03fe4635-b746-4f2a-8c9b-b4bc09b3a62d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-quobyte-05aac35a-3139-48e5-a525-0d5875868e8c" released by "delete_volume" :: held 1.064s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:13 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-03fe4635-b746-4f2a-8c9b-b4bc09b3a62d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Created reservations ['6b86f796-2509-471c-941a-d398ad584240', '5789c8f8-fd1e-49fa-adfb-f0f7f3074cd2', '00e8a4de-3572-4427-ad91-e9bfdefe605e', '8dc0b34b-abfb-4d4e-ab35-03fc9e0f19ab'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:07:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-03fe4635-b746-4f2a-8c9b-b4bc09b3a62d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-03fe4635-b746-4f2a-8c9b-b4bc09b3a62d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-03fe4635-b746-4f2a-8c9b-b4bc09b3a62d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-03fe4635-b746-4f2a-8c9b-b4bc09b3a62d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-03fe4635-b746-4f2a-8c9b-b4bc09b3a62d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-03fe4635-b746-4f2a-8c9b-b4bc09b3a62d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:13 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:07:13 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:13 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-03fe4635-b746-4f2a-8c9b-b4bc09b3a62d tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.492s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:13 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-03fe4635-b746-4f2a-8c9b-b4bc09b3a62d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:07:13 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-03fe4635-b746-4f2a-8c9b-b4bc09b3a62d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Deleted volume successfully. Apr 16 23:07:13 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-03fe4635-b746-4f2a-8c9b-b4bc09b3a62d tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-05aac35a-3139-48e5-a525-0d5875868e8c-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6f2eefbc-6585-4a70-a586-dcac0f848055 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "cinder-41e6a39e-8bc6-4108-92df-b51f270dd39d-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6f2eefbc-6585-4a70-a586-dcac0f848055 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-41e6a39e-8bc6-4108-92df-b51f270dd39d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6f2eefbc-6585-4a70-a586-dcac0f848055 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "cinder-quobyte-41e6a39e-8bc6-4108-92df-b51f270dd39d" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6f2eefbc-6585-4a70-a586-dcac0f848055 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-quobyte-41e6a39e-8bc6-4108-92df-b51f270dd39d" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:14 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf54e5f8-97b6-4543-ac86-f957e380baf2]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:07:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6f2eefbc-6585-4a70-a586-dcac0f848055 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-41e6a39e-8bc6-4108-92df-b51f270dd39d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:14 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-41e6a39e-8bc6-4108-92df-b51f270dd39d Apr 16 23:07:14 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:15 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6f2eefbc-6585-4a70-a586-dcac0f848055 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-41e6a39e-8bc6-4108-92df-b51f270dd39d" returned: 0 in 0.597s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6f2eefbc-6585-4a70-a586-dcac0f848055 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-41e6a39e-8bc6-4108-92df-b51f270dd39d {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:15 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-41e6a39e-8bc6-4108-92df-b51f270dd39d Apr 16 23:07:15 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:15 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6f2eefbc-6585-4a70-a586-dcac0f848055 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-41e6a39e-8bc6-4108-92df-b51f270dd39d" returned: 0 in 0.514s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:15 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6f2eefbc-6585-4a70-a586-dcac0f848055 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-quobyte-41e6a39e-8bc6-4108-92df-b51f270dd39d" released by "delete_volume" :: held 1.143s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:15 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-6f2eefbc-6585-4a70-a586-dcac0f848055 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Created reservations ['cbfde822-ef24-4223-8475-552ca5df05fe', '279d5267-12a9-40cc-b76d-76d8567e7b3c', '987e7929-59e7-4e34-999f-b190042d2190', 'ad1d04a6-5af3-4be6-880c-177615608b28'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:07:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6f2eefbc-6585-4a70-a586-dcac0f848055 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6f2eefbc-6585-4a70-a586-dcac0f848055 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-6f2eefbc-6585-4a70-a586-dcac0f848055 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:15 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-6f2eefbc-6585-4a70-a586-dcac0f848055 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6f2eefbc-6585-4a70-a586-dcac0f848055 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6f2eefbc-6585-4a70-a586-dcac0f848055 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:15 devstack sudo[89967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:07:15 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:16 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6f2eefbc-6585-4a70-a586-dcac0f848055 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.467s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:16 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-6f2eefbc-6585-4a70-a586-dcac0f848055 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:07:16 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-6f2eefbc-6585-4a70-a586-dcac0f848055 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Deleted volume successfully. Apr 16 23:07:16 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6f2eefbc-6585-4a70-a586-dcac0f848055 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-41e6a39e-8bc6-4108-92df-b51f270dd39d-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:16 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8711e014-1412-4547-8e0b-efd70f563696 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "cinder-28d86120-2254-4d67-a311-9e22c974ed2b-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:16 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8711e014-1412-4547-8e0b-efd70f563696 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-28d86120-2254-4d67-a311-9e22c974ed2b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:16 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8711e014-1412-4547-8e0b-efd70f563696 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "cinder-quobyte-28d86120-2254-4d67-a311-9e22c974ed2b" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:16 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8711e014-1412-4547-8e0b-efd70f563696 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-quobyte-28d86120-2254-4d67-a311-9e22c974ed2b" acquired by "delete_volume" :: waited 0.015s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:16 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac53af38-27da-4c44-8e96-c08cc761c4a0]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:07:16 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8711e014-1412-4547-8e0b-efd70f563696 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-28d86120-2254-4d67-a311-9e22c974ed2b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:16 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-28d86120-2254-4d67-a311-9e22c974ed2b Apr 16 23:07:16 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:17 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8711e014-1412-4547-8e0b-efd70f563696 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-28d86120-2254-4d67-a311-9e22c974ed2b" returned: 0 in 0.628s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8711e014-1412-4547-8e0b-efd70f563696 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-28d86120-2254-4d67-a311-9e22c974ed2b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:17 devstack sudo[89975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-28d86120-2254-4d67-a311-9e22c974ed2b Apr 16 23:07:17 devstack sudo[89975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:17 devstack sudo[89975]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8711e014-1412-4547-8e0b-efd70f563696 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-28d86120-2254-4d67-a311-9e22c974ed2b" returned: 0 in 0.522s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:17 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8711e014-1412-4547-8e0b-efd70f563696 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-quobyte-28d86120-2254-4d67-a311-9e22c974ed2b" released by "delete_volume" :: held 1.180s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:17 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-8711e014-1412-4547-8e0b-efd70f563696 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Created reservations ['746e3709-fcee-4564-9867-763977f13bf1', '686c8922-526a-4b43-b1c3-156c6d038cc5', '7cce9e93-00a5-4bb3-9987-f6ac2bc4309e', '256221fd-497e-4977-8f4c-197ff698ee78'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:07:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8711e014-1412-4547-8e0b-efd70f563696 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8711e014-1412-4547-8e0b-efd70f563696 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:17 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-8711e014-1412-4547-8e0b-efd70f563696 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:17 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-8711e014-1412-4547-8e0b-efd70f563696 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8711e014-1412-4547-8e0b-efd70f563696 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8711e014-1412-4547-8e0b-efd70f563696 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:18 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:07:18 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:18 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8711e014-1412-4547-8e0b-efd70f563696 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.422s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:18 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-8711e014-1412-4547-8e0b-efd70f563696 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:07:18 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-8711e014-1412-4547-8e0b-efd70f563696 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Deleted volume successfully. Apr 16 23:07:18 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-8711e014-1412-4547-8e0b-efd70f563696 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-28d86120-2254-4d67-a311-9e22c974ed2b-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:18 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b29ccd69-9302-4fcf-93df-b29e58bc518a tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "cinder-aef929c4-be71-4f18-b732-770e50de065b-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:18 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b29ccd69-9302-4fcf-93df-b29e58bc518a tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-aef929c4-be71-4f18-b732-770e50de065b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:18 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b29ccd69-9302-4fcf-93df-b29e58bc518a tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "cinder-quobyte-aef929c4-be71-4f18-b732-770e50de065b" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:18 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b29ccd69-9302-4fcf-93df-b29e58bc518a tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-quobyte-aef929c4-be71-4f18-b732-770e50de065b" acquired by "delete_volume" :: waited 0.007s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:18 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e3aab3-1adb-4760-86f7-a45a9a2fa347]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:07:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b29ccd69-9302-4fcf-93df-b29e58bc518a tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-aef929c4-be71-4f18-b732-770e50de065b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:18 devstack sudo[89981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-aef929c4-be71-4f18-b732-770e50de065b Apr 16 23:07:18 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:19 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b29ccd69-9302-4fcf-93df-b29e58bc518a tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-aef929c4-be71-4f18-b732-770e50de065b" returned: 0 in 0.528s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b29ccd69-9302-4fcf-93df-b29e58bc518a tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-aef929c4-be71-4f18-b732-770e50de065b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:19 devstack sudo[89986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-aef929c4-be71-4f18-b732-770e50de065b Apr 16 23:07:19 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:19 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b29ccd69-9302-4fcf-93df-b29e58bc518a tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-aef929c4-be71-4f18-b732-770e50de065b" returned: 0 in 0.490s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:19 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b29ccd69-9302-4fcf-93df-b29e58bc518a tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-quobyte-aef929c4-be71-4f18-b732-770e50de065b" released by "delete_volume" :: held 1.040s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:19 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-b29ccd69-9302-4fcf-93df-b29e58bc518a tempest-CreateVolumesFromSnapshotTest-1207665203 None] Created reservations ['6e97ccd2-8c0a-4a6c-b29b-3f21da108649', '35cea9af-faf2-4d28-b260-00f962f398f1', '77bbfd46-1b25-47b0-90f8-601d550b775a', '9432f91a-4814-4686-a83a-1161680f7271'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:07:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b29ccd69-9302-4fcf-93df-b29e58bc518a tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b29ccd69-9302-4fcf-93df-b29e58bc518a tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:20 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b29ccd69-9302-4fcf-93df-b29e58bc518a tempest-CreateVolumesFromSnapshotTest-1207665203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:20 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b29ccd69-9302-4fcf-93df-b29e58bc518a tempest-CreateVolumesFromSnapshotTest-1207665203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b29ccd69-9302-4fcf-93df-b29e58bc518a tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b29ccd69-9302-4fcf-93df-b29e58bc518a tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:20 devstack sudo[89989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:07:20 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:20 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b29ccd69-9302-4fcf-93df-b29e58bc518a tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.401s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:20 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-b29ccd69-9302-4fcf-93df-b29e58bc518a tempest-CreateVolumesFromSnapshotTest-1207665203 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:07:20 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-b29ccd69-9302-4fcf-93df-b29e58bc518a tempest-CreateVolumesFromSnapshotTest-1207665203 None] Deleted volume successfully. Apr 16 23:07:20 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b29ccd69-9302-4fcf-93df-b29e58bc518a tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-aef929c4-be71-4f18-b732-770e50de065b-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4529f822-28f0-45fd-bcf8-6e8a90364948 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "cinder-d6efb45b-818d-43b0-9820-7049500e85d3-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4529f822-28f0-45fd-bcf8-6e8a90364948 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-d6efb45b-818d-43b0-9820-7049500e85d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4529f822-28f0-45fd-bcf8-6e8a90364948 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "cinder-quobyte-26282f9e-0230-4d53-8999-eb06fa612cfc" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4529f822-28f0-45fd-bcf8-6e8a90364948 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-quobyte-26282f9e-0230-4d53-8999-eb06fa612cfc" acquired by "delete_snapshot" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4529f822-28f0-45fd-bcf8-6e8a90364948 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "cinder-quobyte-d6efb45b-818d-43b0-9820-7049500e85d3" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4529f822-28f0-45fd-bcf8-6e8a90364948 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-quobyte-d6efb45b-818d-43b0-9820-7049500e85d3" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-4529f822-28f0-45fd-bcf8-6e8a90364948 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Deleting offline snapshot d6efb45b-818d-43b0-9820-7049500e85d3 of volume 26282f9e-0230-4d53-8999-eb06fa612cfc {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:07:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-4529f822-28f0-45fd-bcf8-6e8a90364948 tempest-CreateVolumesFromSnapshotTest-1207665203 None] snapshot_file for this snap is: volume-26282f9e-0230-4d53-8999-eb06fa612cfc.d6efb45b-818d-43b0-9820-7049500e85d3 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:07:21 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1532a3-8b61-4de3-a9bb-026228e2cf9a]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:07:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4529f822-28f0-45fd-bcf8-6e8a90364948 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.d6efb45b-818d-43b0-9820-7049500e85d3 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:21 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.d6efb45b-818d-43b0-9820-7049500e85d3 Apr 16 23:07:21 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:21 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4529f822-28f0-45fd-bcf8-6e8a90364948 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.d6efb45b-818d-43b0-9820-7049500e85d3" returned: 0 in 0.481s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-4529f822-28f0-45fd-bcf8-6e8a90364948 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26282f9e-0230-4d53-8999-eb06fa612cfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:07:21 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef8d69f-cab2-4610-a38f-5ea42a5be2a2]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:07:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4529f822-28f0-45fd-bcf8-6e8a90364948 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:21 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc Apr 16 23:07:21 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:22 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4529f822-28f0-45fd-bcf8-6e8a90364948 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc" returned: 0 in 0.475s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4529f822-28f0-45fd-bcf8-6e8a90364948 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.d6efb45b-818d-43b0-9820-7049500e85d3 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:22 devstack sudo[90002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.d6efb45b-818d-43b0-9820-7049500e85d3 Apr 16 23:07:22 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:22 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4529f822-28f0-45fd-bcf8-6e8a90364948 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.d6efb45b-818d-43b0-9820-7049500e85d3" returned: 0 in 0.449s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4529f822-28f0-45fd-bcf8-6e8a90364948 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.d6efb45b-818d-43b0-9820-7049500e85d3 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:22 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.d6efb45b-818d-43b0-9820-7049500e85d3 Apr 16 23:07:22 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:22 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4529f822-28f0-45fd-bcf8-6e8a90364948 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc.d6efb45b-818d-43b0-9820-7049500e85d3" returned: 0 in 0.416s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4529f822-28f0-45fd-bcf8-6e8a90364948 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-quobyte-d6efb45b-818d-43b0-9820-7049500e85d3" released by "_delete_snapshot" :: held 1.879s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4529f822-28f0-45fd-bcf8-6e8a90364948 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-quobyte-26282f9e-0230-4d53-8999-eb06fa612cfc" released by "delete_snapshot" :: held 1.892s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:22 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-4529f822-28f0-45fd-bcf8-6e8a90364948 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Created reservations ['acfd3260-de3c-4f32-ae94-bed635827a72', '8798493c-e63b-415c-a334-a7d94e365d81', '76eaf119-a32c-4ba2-a4cb-0a22791099e5', '6e045ff5-372e-4c32-b8fe-8f87f443e63d'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:07:23 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-4529f822-28f0-45fd-bcf8-6e8a90364948 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Delete snapshot completed successfully. Apr 16 23:07:23 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4529f822-28f0-45fd-bcf8-6e8a90364948 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-d6efb45b-818d-43b0-9820-7049500e85d3-delete_snapshot" released by "delete_snapshot" :: held 1.974s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:23 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ddb74fbd-b014-4f39-82d6-829ab337ce00 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "cinder-26282f9e-0230-4d53-8999-eb06fa612cfc-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:23 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ddb74fbd-b014-4f39-82d6-829ab337ce00 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-26282f9e-0230-4d53-8999-eb06fa612cfc-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:23 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ddb74fbd-b014-4f39-82d6-829ab337ce00 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "cinder-quobyte-26282f9e-0230-4d53-8999-eb06fa612cfc" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:23 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ddb74fbd-b014-4f39-82d6-829ab337ce00 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-quobyte-26282f9e-0230-4d53-8999-eb06fa612cfc" acquired by "delete_volume" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:23 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[43069b42-5b38-4d1a-8ed9-2e7a23f17619]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:07:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ddb74fbd-b014-4f39-82d6-829ab337ce00 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:23 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc Apr 16 23:07:23 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:23 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ddb74fbd-b014-4f39-82d6-829ab337ce00 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc" returned: 0 in 0.474s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ddb74fbd-b014-4f39-82d6-829ab337ce00 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:23 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc Apr 16 23:07:23 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:24 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ddb74fbd-b014-4f39-82d6-829ab337ce00 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-26282f9e-0230-4d53-8999-eb06fa612cfc" returned: 0 in 0.406s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:24 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ddb74fbd-b014-4f39-82d6-829ab337ce00 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-quobyte-26282f9e-0230-4d53-8999-eb06fa612cfc" released by "delete_volume" :: held 0.908s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:24 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-ddb74fbd-b014-4f39-82d6-829ab337ce00 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Created reservations ['5529322a-292a-4f9c-b5b8-e565b82998cc', '11243c1d-b443-41b2-ae15-6b7783b68dcd', '7a7de3ff-4cdc-4790-8f1f-c0744d659215', '873a18e6-40e9-422a-acba-7ede0a329380'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:07:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ddb74fbd-b014-4f39-82d6-829ab337ce00 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ddb74fbd-b014-4f39-82d6-829ab337ce00 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:24 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ddb74fbd-b014-4f39-82d6-829ab337ce00 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:24 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ddb74fbd-b014-4f39-82d6-829ab337ce00 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ddb74fbd-b014-4f39-82d6-829ab337ce00 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ddb74fbd-b014-4f39-82d6-829ab337ce00 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:24 devstack sudo[90019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:07:24 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:24 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ddb74fbd-b014-4f39-82d6-829ab337ce00 tempest-CreateVolumesFromSnapshotTest-1207665203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.498s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:24 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-ddb74fbd-b014-4f39-82d6-829ab337ce00 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:07:24 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-ddb74fbd-b014-4f39-82d6-829ab337ce00 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Deleted volume successfully. Apr 16 23:07:24 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:UPDATE=113,cinder:SELECT=64,cinder:DELETE=10,cinder:INSERT=21 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 23:07:24 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ddb74fbd-b014-4f39-82d6-829ab337ce00 tempest-CreateVolumesFromSnapshotTest-1207665203 None] Lock "cinder-26282f9e-0230-4d53-8999-eb06fa612cfc-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:SELECT=87,cinder:UPDATE=103,cinder:INSERT=31,cinder:DELETE=9 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Flow 'volume_create_manager' (eb0bf17d-4a05-42c1-80ae-5b8bcce29715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71abfa5d-2012-497a-9fc2-bf74acd002bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71abfa5d-2012-497a-9fc2-bf74acd002bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1718487618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5ae43b5-e600-4068-b081-d2f9039bb1e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170268b0c7af46c0bdeecc894470a32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:32Z,use_quota=True,user_id='4f8ac8f7814849e4bd4114944852a269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e3831a4-10f2-49b7-b22e-741e0231bf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e3831a4-10f2-49b7-b22e-741e0231bf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d9e8dc9-dc43-4cfd-8fee-7cd20128d88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d9e8dc9-dc43-4cfd-8fee-7cd20128d88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5ae43b5-e600-4068-b081-d2f9039bb1e4', 'volume_name': 'volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17b21e58-cd21-414d-aa63-db94607b5fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17b21e58-cd21-414d-aa63-db94607b5fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d85d5c8-bdab-4191-9da5-22379a978e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:32 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Volume e5ae43b5-e600-4068-b081-d2f9039bb1e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4', 'volume_size': 1} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1718487618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5ae43b5-e600-4068-b081-d2f9039bb1e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170268b0c7af46c0bdeecc894470a32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:32Z,use_quota=True,user_id='4f8ac8f7814849e4bd4114944852a269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Creating volume e5ae43b5-e600-4068-b081-d2f9039bb1e4 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:07:32 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:32 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4 1073741824 Apr 16 23:07:32 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Flow 'volume_create_manager' (bcaea245-6eca-4003-a6a1-c30355f7bf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27bb1a33-b36f-4b31-93ab-c26d2f78e6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27bb1a33-b36f-4b31-93ab-c26d2f78e6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1180457508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b52fff3-882e-49ff-883a-c1a820ddb562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947f0ee86328495ba7f027f073cfe0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:32Z,use_quota=True,user_id='2737acc8e6be4dd49775e6a8b094da56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (207c1125-09f9-4721-a3b0-7a040a9b819b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (207c1125-09f9-4721-a3b0-7a040a9b819b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4bb909-abe8-4f77-bdb5-aaf438e80c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4bb909-abe8-4f77-bdb5-aaf438e80c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b52fff3-882e-49ff-883a-c1a820ddb562', 'volume_name': 'volume-0b52fff3-882e-49ff-883a-c1a820ddb562', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6416f342-1d34-4f07-80f1-a457d35d62be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6416f342-1d34-4f07-80f1-a457d35d62be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1bc4845-b092-4938-8118-28f7bfe1f4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:32 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Volume 0b52fff3-882e-49ff-883a-c1a820ddb562: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b52fff3-882e-49ff-883a-c1a820ddb562', 'volume_size': 1} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Flow 'volume_create_manager' (4013327a-8e5a-4724-97d2-001616bcd997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a609681-7bc5-47b1-8ab8-ec23578044be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a609681-7bc5-47b1-8ab8-ec23578044be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1930540696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d07b44ff-c7b8-48c3-85e6-0706cbdd501c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870dc013e187438ab868fc30fc3d817d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:32Z,use_quota=True,user_id='3dcf96e99c60435fbff95073c016e235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9553d723-8f07-4322-b731-c270a1072679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9553d723-8f07-4322-b731-c270a1072679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26dd546f-4684-459c-92e5-beadc36e91f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26dd546f-4684-459c-92e5-beadc36e91f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd07b44ff-c7b8-48c3-85e6-0706cbdd501c', 'volume_name': 'volume-d07b44ff-c7b8-48c3-85e6-0706cbdd501c', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83eb6b52-b2f3-47f5-9e6f-27309842891d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83eb6b52-b2f3-47f5-9e6f-27309842891d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f81965-5fe4-4dc4-8036-4d643c579e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:32 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Volume d07b44ff-c7b8-48c3-85e6-0706cbdd501c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d07b44ff-c7b8-48c3-85e6-0706cbdd501c', 'volume_size': 1} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Flow 'volume_create_manager' (8c2bf1b2-64e9-4dbf-aec7-b1a453ca9c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37dd66ee-af58-490b-9982-f939781b8cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37dd66ee-af58-490b-9982-f939781b8cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1544336796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a34929-5492-499a-b210-b8e3f0eb33b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870dc013e187438ab868fc30fc3d817d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:33Z,use_quota=True,user_id='3dcf96e99c60435fbff95073c016e235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306284eb-00f5-49b5-9884-feac8669ee00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306284eb-00f5-49b5-9884-feac8669ee00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca1ac147-6177-48e6-8d43-31c756e6d983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca1ac147-6177-48e6-8d43-31c756e6d983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5a34929-5492-499a-b210-b8e3f0eb33b6', 'volume_name': 'volume-a5a34929-5492-499a-b210-b8e3f0eb33b6', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9572031b-be1b-4a7a-adcb-f61ddc560285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9572031b-be1b-4a7a-adcb-f61ddc560285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45cbc69-5443-4ac2-ba62-af51903f874e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:32 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Volume a5a34929-5492-499a-b210-b8e3f0eb33b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5a34929-5492-499a-b210-b8e3f0eb33b6', 'volume_size': 1} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:32 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4 1073741824" returned: 0 in 0.719s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:32 devstack sudo[90068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4 Apr 16 23:07:32 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Flow 'volume_create_manager' (6d90a1b6-29ae-4d6a-a90b-9e808b2c8f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84abe1b8-354e-44b0-8ff7-bdd16722f6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84abe1b8-354e-44b0-8ff7-bdd16722f6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1479614979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4a3417-37d7-499b-82e2-4afeab0a27d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870dc013e187438ab868fc30fc3d817d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:33Z,use_quota=True,user_id='3dcf96e99c60435fbff95073c016e235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (becc1dd5-5d4a-4fbd-8390-501352294f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (becc1dd5-5d4a-4fbd-8390-501352294f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5fa2d4a-99f5-4bde-9029-15f57a19d4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5fa2d4a-99f5-4bde-9029-15f57a19d4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc4a3417-37d7-499b-82e2-4afeab0a27d9', 'volume_name': 'volume-cc4a3417-37d7-499b-82e2-4afeab0a27d9', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb6a2ff-8124-4f94-a46d-31321b9c6d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb6a2ff-8124-4f94-a46d-31321b9c6d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef951b6-80aa-4786-8e41-f4dbdafe30e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:33 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Volume cc4a3417-37d7-499b-82e2-4afeab0a27d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc4a3417-37d7-499b-82e2-4afeab0a27d9', 'volume_size': 1} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Flow 'volume_create_manager' (f6c02128-89e1-4000-a9d1-93ef5411e2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8969531-3142-4d61-b0cc-6ac29e7cad44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8969531-3142-4d61-b0cc-6ac29e7cad44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1836113726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=425e9069-ba88-4784-83d0-f7c0b2706ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870dc013e187438ab868fc30fc3d817d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:33Z,use_quota=True,user_id='3dcf96e99c60435fbff95073c016e235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1cc16d-2fd9-45a5-a1c2-9b958cbabf77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1cc16d-2fd9-45a5-a1c2-9b958cbabf77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab17118-5ffb-44de-8810-64647e140168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fab17118-5ffb-44de-8810-64647e140168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '425e9069-ba88-4784-83d0-f7c0b2706ac0', 'volume_name': 'volume-425e9069-ba88-4784-83d0-f7c0b2706ac0', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3f1d72-3c5b-4d11-92aa-5a361fa5eed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b3f1d72-3c5b-4d11-92aa-5a361fa5eed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a302e2a0-5494-4e9c-95b9-9ff49338c9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:33 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Volume 425e9069-ba88-4784-83d0-f7c0b2706ac0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-425e9069-ba88-4784-83d0-f7c0b2706ac0', 'volume_size': 1} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Flow 'volume_create_manager' (8aa943b0-7418-41c6-a883-1c0f43b1cac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:33 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be36ec5d-18c9-408a-b19c-9a94e41d2b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be36ec5d-18c9-408a-b19c-9a94e41d2b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1529585121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ad7d5ff-bf1c-4894-9185-19e72524d3e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870dc013e187438ab868fc30fc3d817d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:33Z,use_quota=True,user_id='3dcf96e99c60435fbff95073c016e235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc60397-f7ce-4ea1-96d3-fa76ae8090bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc60397-f7ce-4ea1-96d3-fa76ae8090bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db057e11-4b9d-4c88-b6a9-54ffcb4d2863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db057e11-4b9d-4c88-b6a9-54ffcb4d2863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ad7d5ff-bf1c-4894-9185-19e72524d3e0', 'volume_name': 'volume-3ad7d5ff-bf1c-4894-9185-19e72524d3e0', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12804a03-df44-4587-9a33-c0dbd94d2f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12804a03-df44-4587-9a33-c0dbd94d2f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eecd4133-9b61-425c-a0fd-bfa63bbb170c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:33 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Volume 3ad7d5ff-bf1c-4894-9185-19e72524d3e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ad7d5ff-bf1c-4894-9185-19e72524d3e0', 'volume_size': 1} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4" returned: 0 in 0.649s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.273s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1180457508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b52fff3-882e-49ff-883a-c1a820ddb562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947f0ee86328495ba7f027f073cfe0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:32Z,use_quota=True,user_id='2737acc8e6be4dd49775e6a8b094da56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Creating volume 0b52fff3-882e-49ff-883a-c1a820ddb562 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:07:33 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d85d5c8-bdab-4191-9da5-22379a978e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:33 devstack sudo[90071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562 1073741824 Apr 16 23:07:33 devstack sudo[90071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (924d3385-2346-4385-8d74-434a2bfb0074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:33 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Volume volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4 (e5ae43b5-e600-4068-b081-d2f9039bb1e4): created successfully Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (924d3385-2346-4385-8d74-434a2bfb0074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Flow 'volume_create_manager' (eb0bf17d-4a05-42c1-80ae-5b8bcce29715) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:33 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-a3fccf91-7bd9-48ad-8e99-1855176d2846 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Created volume successfully. Apr 16 23:07:34 devstack sudo[90071]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562 1073741824" returned: 0 in 0.575s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:34 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562 Apr 16 23:07:34 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8d91ace7-1cf2-4c7e-b579-3fcc551ac12c tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:34 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562" returned: 0 in 0.515s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:34 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:07:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.156s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:34 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1930540696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d07b44ff-c7b8-48c3-85e6-0706cbdd501c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870dc013e187438ab868fc30fc3d817d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:32Z,use_quota=True,user_id='3dcf96e99c60435fbff95073c016e235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:07:34 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Creating volume d07b44ff-c7b8-48c3-85e6-0706cbdd501c {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:07:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:34 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:34 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:34 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:07:34 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:07:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d07b44ff-c7b8-48c3-85e6-0706cbdd501c 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1bc4845-b092-4938-8118-28f7bfe1f4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b52fff3-882e-49ff-883a-c1a820ddb562', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:34 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d07b44ff-c7b8-48c3-85e6-0706cbdd501c 1073741824 Apr 16 23:07:34 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cb91b1b-77ad-40a0-8944-b3cc8b667017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:34 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Volume volume-0b52fff3-882e-49ff-883a-c1a820ddb562 (0b52fff3-882e-49ff-883a-c1a820ddb562): created successfully Apr 16 23:07:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cb91b1b-77ad-40a0-8944-b3cc8b667017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Flow 'volume_create_manager' (bcaea245-6eca-4003-a6a1-c30355f7bf2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:34 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-7d61d432-1063-4326-bc48-dae4ed3cb3d9 tempest-VolumeDependencyTests-786286978 None] Created volume successfully. Apr 16 23:07:35 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d07b44ff-c7b8-48c3-85e6-0706cbdd501c 1073741824" returned: 0 in 0.616s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d07b44ff-c7b8-48c3-85e6-0706cbdd501c {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:35 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d07b44ff-c7b8-48c3-85e6-0706cbdd501c Apr 16 23:07:35 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-7621f92d-4a02-4609-b68e-64e6698b594d tempest-VolumeDependencyTests-786286978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:35 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d07b44ff-c7b8-48c3-85e6-0706cbdd501c" returned: 0 in 0.573s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:07:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.126s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1544336796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5a34929-5492-499a-b210-b8e3f0eb33b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870dc013e187438ab868fc30fc3d817d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:33Z,use_quota=True,user_id='3dcf96e99c60435fbff95073c016e235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:07:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Creating volume a5a34929-5492-499a-b210-b8e3f0eb33b6 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:07:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:07:35 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:07:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a5a34929-5492-499a-b210-b8e3f0eb33b6 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f81965-5fe4-4dc4-8036-4d643c579e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d07b44ff-c7b8-48c3-85e6-0706cbdd501c', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3bcc659-5c79-42c3-88f7-35b56cacf341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:35 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a5a34929-5492-499a-b210-b8e3f0eb33b6 1073741824 Apr 16 23:07:35 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:35 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Volume volume-d07b44ff-c7b8-48c3-85e6-0706cbdd501c (d07b44ff-c7b8-48c3-85e6-0706cbdd501c): created successfully Apr 16 23:07:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3bcc659-5c79-42c3-88f7-35b56cacf341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Flow 'volume_create_manager' (4013327a-8e5a-4724-97d2-001616bcd997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:35 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-5676cf9a-2bfe-4b90-a495-4728d794326c tempest-CreateVolumesFromImageTest-68393813 None] Created volume successfully. Apr 16 23:07:36 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a5a34929-5492-499a-b210-b8e3f0eb33b6 1073741824" returned: 0 in 0.550s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a5a34929-5492-499a-b210-b8e3f0eb33b6 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:36 devstack sudo[90092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a5a34929-5492-499a-b210-b8e3f0eb33b6 Apr 16 23:07:36 devstack sudo[90092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:36 devstack sudo[90092]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a5a34929-5492-499a-b210-b8e3f0eb33b6" returned: 0 in 0.481s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:07:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.922s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1479614979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4a3417-37d7-499b-82e2-4afeab0a27d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870dc013e187438ab868fc30fc3d817d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:33Z,use_quota=True,user_id='3dcf96e99c60435fbff95073c016e235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:07:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Creating volume cc4a3417-37d7-499b-82e2-4afeab0a27d9 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:07:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:07:36 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:07:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-cc4a3417-37d7-499b-82e2-4afeab0a27d9 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45cbc69-5443-4ac2-ba62-af51903f874e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5a34929-5492-499a-b210-b8e3f0eb33b6', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09460191-c144-4855-9f88-97fde4d8e8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:37 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-cc4a3417-37d7-499b-82e2-4afeab0a27d9 1073741824 Apr 16 23:07:37 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:37 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Volume volume-a5a34929-5492-499a-b210-b8e3f0eb33b6 (a5a34929-5492-499a-b210-b8e3f0eb33b6): created successfully Apr 16 23:07:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09460191-c144-4855-9f88-97fde4d8e8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:37 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Flow 'volume_create_manager' (8c2bf1b2-64e9-4dbf-aec7-b1a453ca9c96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:37 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-090ada26-e2e5-45db-8557-18e539c8a1e6 tempest-CreateVolumesFromImageTest-68393813 None] Created volume successfully. Apr 16 23:07:37 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-cc4a3417-37d7-499b-82e2-4afeab0a27d9 1073741824" returned: 0 in 0.639s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-cc4a3417-37d7-499b-82e2-4afeab0a27d9 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:37 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-cc4a3417-37d7-499b-82e2-4afeab0a27d9 Apr 16 23:07:37 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:38 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-cc4a3417-37d7-499b-82e2-4afeab0a27d9" returned: 0 in 0.481s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:38 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:07:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.803s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:38 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1836113726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=425e9069-ba88-4784-83d0-f7c0b2706ac0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870dc013e187438ab868fc30fc3d817d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:33Z,use_quota=True,user_id='3dcf96e99c60435fbff95073c016e235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:07:38 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Creating volume 425e9069-ba88-4784-83d0-f7c0b2706ac0 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:07:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:38 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:38 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:38 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:07:38 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:07:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-425e9069-ba88-4784-83d0-f7c0b2706ac0 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef951b6-80aa-4786-8e41-f4dbdafe30e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc4a3417-37d7-499b-82e2-4afeab0a27d9', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42072a91-3f7f-4ba9-8c93-16bb449cb44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:38 devstack sudo[90103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-425e9069-ba88-4784-83d0-f7c0b2706ac0 1073741824 Apr 16 23:07:38 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:38 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Volume volume-cc4a3417-37d7-499b-82e2-4afeab0a27d9 (cc4a3417-37d7-499b-82e2-4afeab0a27d9): created successfully Apr 16 23:07:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42072a91-3f7f-4ba9-8c93-16bb449cb44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:38 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Flow 'volume_create_manager' (6d90a1b6-29ae-4d6a-a90b-9e808b2c8f66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:38 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-c458774b-1424-44a0-9300-74ef2ae4bdc1 tempest-CreateVolumesFromImageTest-68393813 None] Created volume successfully. Apr 16 23:07:38 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-425e9069-ba88-4784-83d0-f7c0b2706ac0 1073741824" returned: 0 in 0.702s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-425e9069-ba88-4784-83d0-f7c0b2706ac0 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:38 devstack sudo[90108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-425e9069-ba88-4784-83d0-f7c0b2706ac0 Apr 16 23:07:38 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:39 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-425e9069-ba88-4784-83d0-f7c0b2706ac0" returned: 0 in 0.645s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:39 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:07:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.008s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:39 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1529585121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ad7d5ff-bf1c-4894-9185-19e72524d3e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='870dc013e187438ab868fc30fc3d817d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:33Z,use_quota=True,user_id='3dcf96e99c60435fbff95073c016e235',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:07:39 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Creating volume 3ad7d5ff-bf1c-4894-9185-19e72524d3e0 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:07:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:39 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:39 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:39 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:07:39 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:07:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ad7d5ff-bf1c-4894-9185-19e72524d3e0 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a302e2a0-5494-4e9c-95b9-9ff49338c9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-425e9069-ba88-4784-83d0-f7c0b2706ac0', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751b9368-26b0-46ed-a624-e67bc884237f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:39 devstack sudo[90111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ad7d5ff-bf1c-4894-9185-19e72524d3e0 1073741824 Apr 16 23:07:39 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:39 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Volume volume-425e9069-ba88-4784-83d0-f7c0b2706ac0 (425e9069-ba88-4784-83d0-f7c0b2706ac0): created successfully Apr 16 23:07:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751b9368-26b0-46ed-a624-e67bc884237f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:39 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Flow 'volume_create_manager' (f6c02128-89e1-4000-a9d1-93ef5411e2a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:39 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-214fb3e2-4d26-43ef-b700-e08cc5ce4a8d tempest-CreateVolumesFromImageTest-68393813 None] Created volume successfully. Apr 16 23:07:40 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ad7d5ff-bf1c-4894-9185-19e72524d3e0 1073741824" returned: 0 in 0.679s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ad7d5ff-bf1c-4894-9185-19e72524d3e0 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:40 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ad7d5ff-bf1c-4894-9185-19e72524d3e0 Apr 16 23:07:40 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:40 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ad7d5ff-bf1c-4894-9185-19e72524d3e0" returned: 0 in 0.562s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:07:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8d91ace7-1cf2-4c7e-b579-3fcc551ac12c tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.311s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-8d91ace7-1cf2-4c7e-b579-3fcc551ac12c tempest-CreateVolumesFromSnapshotTest-1245930787 None] Creating offline snapshot 83346606-41a6-4730-8368-3747a85c6fe7 of volume e5ae43b5-e600-4068-b081-d2f9039bb1e4 {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:07:40 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eecd4133-9b61-425c-a0fd-bfa63bbb170c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ad7d5ff-bf1c-4894-9185-19e72524d3e0', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:40 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29791e9d-cafe-46ac-a1a0-01f9990853e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:40 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a1f20a-2a53-4c64-bde6-dcce4dae2c7a]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:07:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8d91ace7-1cf2-4c7e-b579-3fcc551ac12c tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:40 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Volume volume-3ad7d5ff-bf1c-4894-9185-19e72524d3e0 (3ad7d5ff-bf1c-4894-9185-19e72524d3e0): created successfully Apr 16 23:07:40 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29791e9d-cafe-46ac-a1a0-01f9990853e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:40 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Flow 'volume_create_manager' (8aa943b0-7418-41c6-a883-1c0f43b1cac5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:40 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-24a7e77f-42e2-483f-aecf-fd5f94fa6019 tempest-CreateVolumesFromImageTest-68393813 None] Created volume successfully. Apr 16 23:07:40 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4 Apr 16 23:07:40 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:41 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-63aaa04a-57bb-4ee1-a833-84f61b10195e tempest-CreateVolumesFromImageTest-68393813 None] Acquiring lock "cinder-3ad7d5ff-bf1c-4894-9185-19e72524d3e0-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:41 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-63aaa04a-57bb-4ee1-a833-84f61b10195e tempest-CreateVolumesFromImageTest-68393813 None] Lock "cinder-3ad7d5ff-bf1c-4894-9185-19e72524d3e0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:41 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-63aaa04a-57bb-4ee1-a833-84f61b10195e tempest-CreateVolumesFromImageTest-68393813 None] Acquiring lock "cinder-quobyte-3ad7d5ff-bf1c-4894-9185-19e72524d3e0" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:41 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-63aaa04a-57bb-4ee1-a833-84f61b10195e tempest-CreateVolumesFromImageTest-68393813 None] Lock "cinder-quobyte-3ad7d5ff-bf1c-4894-9185-19e72524d3e0" acquired by "delete_volume" :: waited 0.009s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:41 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3f0d14-34c3-4205-ad30-2af41072eb63]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:07:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-63aaa04a-57bb-4ee1-a833-84f61b10195e tempest-CreateVolumesFromImageTest-68393813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ad7d5ff-bf1c-4894-9185-19e72524d3e0 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:41 devstack sudo[90121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ad7d5ff-bf1c-4894-9185-19e72524d3e0 Apr 16 23:07:41 devstack sudo[90121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:41 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8d91ace7-1cf2-4c7e-b579-3fcc551ac12c tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4" returned: 0 in 0.687s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8d91ace7-1cf2-4c7e-b579-3fcc551ac12c tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.83346606-41a6-4730-8368-3747a85c6fe7 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:41 devstack sudo[90126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.83346606-41a6-4730-8368-3747a85c6fe7 1G Apr 16 23:07:41 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:41 devstack sudo[90121]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-63aaa04a-57bb-4ee1-a833-84f61b10195e tempest-CreateVolumesFromImageTest-68393813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ad7d5ff-bf1c-4894-9185-19e72524d3e0" returned: 0 in 0.650s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-63aaa04a-57bb-4ee1-a833-84f61b10195e tempest-CreateVolumesFromImageTest-68393813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ad7d5ff-bf1c-4894-9185-19e72524d3e0 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:42 devstack sudo[90131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ad7d5ff-bf1c-4894-9185-19e72524d3e0 Apr 16 23:07:42 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:42 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8d91ace7-1cf2-4c7e-b579-3fcc551ac12c tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.83346606-41a6-4730-8368-3747a85c6fe7 1G" returned: 0 in 0.741s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8d91ace7-1cf2-4c7e-b579-3fcc551ac12c tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.83346606-41a6-4730-8368-3747a85c6fe7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:42 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.83346606-41a6-4730-8368-3747a85c6fe7 Apr 16 23:07:42 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:42 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-63aaa04a-57bb-4ee1-a833-84f61b10195e tempest-CreateVolumesFromImageTest-68393813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3ad7d5ff-bf1c-4894-9185-19e72524d3e0" returned: 0 in 0.614s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:42 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-63aaa04a-57bb-4ee1-a833-84f61b10195e tempest-CreateVolumesFromImageTest-68393813 None] Lock "cinder-quobyte-3ad7d5ff-bf1c-4894-9185-19e72524d3e0" released by "delete_volume" :: held 1.293s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:42 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-63aaa04a-57bb-4ee1-a833-84f61b10195e tempest-CreateVolumesFromImageTest-68393813 None] Created reservations ['61f1227f-0818-4cb5-b763-d12b97343174', 'ab0adc24-d8ad-4de5-ae23-a674340b57d1', '6f40840e-4b46-4113-9644-ac36b8b12694', 'cbb14013-b301-4b84-b666-c66ed2ed71c5'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:07:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-63aaa04a-57bb-4ee1-a833-84f61b10195e tempest-CreateVolumesFromImageTest-68393813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-63aaa04a-57bb-4ee1-a833-84f61b10195e tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:42 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-63aaa04a-57bb-4ee1-a833-84f61b10195e tempest-CreateVolumesFromImageTest-68393813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:42 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-63aaa04a-57bb-4ee1-a833-84f61b10195e tempest-CreateVolumesFromImageTest-68393813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-63aaa04a-57bb-4ee1-a833-84f61b10195e tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-63aaa04a-57bb-4ee1-a833-84f61b10195e tempest-CreateVolumesFromImageTest-68393813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:42 devstack sudo[90141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:07:42 devstack sudo[90141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:42 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8d91ace7-1cf2-4c7e-b579-3fcc551ac12c tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.83346606-41a6-4730-8368-3747a85c6fe7" returned: 0 in 0.616s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:42 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-8d91ace7-1cf2-4c7e-b579-3fcc551ac12c tempest-CreateVolumesFromSnapshotTest-1245930787 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.83346606-41a6-4730-8368-3747a85c6fe7 is being set with open permissions: ugo+rw Apr 16 23:07:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8d91ace7-1cf2-4c7e-b579-3fcc551ac12c tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.83346606-41a6-4730-8368-3747a85c6fe7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:43 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.83346606-41a6-4730-8368-3747a85c6fe7 Apr 16 23:07:43 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:43 devstack sudo[90141]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-63aaa04a-57bb-4ee1-a833-84f61b10195e tempest-CreateVolumesFromImageTest-68393813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.584s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:43 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-63aaa04a-57bb-4ee1-a833-84f61b10195e tempest-CreateVolumesFromImageTest-68393813 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:07:43 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-63aaa04a-57bb-4ee1-a833-84f61b10195e tempest-CreateVolumesFromImageTest-68393813 None] Deleted volume successfully. Apr 16 23:07:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-63aaa04a-57bb-4ee1-a833-84f61b10195e tempest-CreateVolumesFromImageTest-68393813 None] Lock "cinder-3ad7d5ff-bf1c-4894-9185-19e72524d3e0-delete_volume" released by "delete_volume" :: held 2.080s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:43 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8d91ace7-1cf2-4c7e-b579-3fcc551ac12c tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.83346606-41a6-4730-8368-3747a85c6fe7" returned: 0 in 0.576s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5e096443-e595-4a03-a85f-72f582487316 tempest-CreateVolumesFromImageTest-68393813 None] Acquiring lock "cinder-425e9069-ba88-4784-83d0-f7c0b2706ac0-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8d91ace7-1cf2-4c7e-b579-3fcc551ac12c tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5e096443-e595-4a03-a85f-72f582487316 tempest-CreateVolumesFromImageTest-68393813 None] Lock "cinder-425e9069-ba88-4784-83d0-f7c0b2706ac0-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:43 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.info Apr 16 23:07:43 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5e096443-e595-4a03-a85f-72f582487316 tempest-CreateVolumesFromImageTest-68393813 None] Acquiring lock "cinder-quobyte-425e9069-ba88-4784-83d0-f7c0b2706ac0" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5e096443-e595-4a03-a85f-72f582487316 tempest-CreateVolumesFromImageTest-68393813 None] Lock "cinder-quobyte-425e9069-ba88-4784-83d0-f7c0b2706ac0" acquired by "delete_volume" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:43 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd3e748-6093-4d6d-ae19-d5568bf7a87d]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:07:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5e096443-e595-4a03-a85f-72f582487316 tempest-CreateVolumesFromImageTest-68393813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-425e9069-ba88-4784-83d0-f7c0b2706ac0 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:43 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-425e9069-ba88-4784-83d0-f7c0b2706ac0 Apr 16 23:07:43 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:44 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8d91ace7-1cf2-4c7e-b579-3fcc551ac12c tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.info" returned: 0 in 0.503s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:44 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-8d91ace7-1cf2-4c7e-b579-3fcc551ac12c tempest-CreateVolumesFromSnapshotTest-1245930787 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.info is being set with open permissions: ugo+rw Apr 16 23:07:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8d91ace7-1cf2-4c7e-b579-3fcc551ac12c tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:44 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.info Apr 16 23:07:44 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:44 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5e096443-e595-4a03-a85f-72f582487316 tempest-CreateVolumesFromImageTest-68393813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-425e9069-ba88-4784-83d0-f7c0b2706ac0" returned: 0 in 0.592s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5e096443-e595-4a03-a85f-72f582487316 tempest-CreateVolumesFromImageTest-68393813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-425e9069-ba88-4784-83d0-f7c0b2706ac0 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:44 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-425e9069-ba88-4784-83d0-f7c0b2706ac0 Apr 16 23:07:44 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:44 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8d91ace7-1cf2-4c7e-b579-3fcc551ac12c tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.info" returned: 0 in 0.481s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8d91ace7-1cf2-4c7e-b579-3fcc551ac12c tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.720s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-7621f92d-4a02-4609-b68e-64e6698b594d tempest-VolumeDependencyTests-786286978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.938s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:44 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-7621f92d-4a02-4609-b68e-64e6698b594d tempest-VolumeDependencyTests-786286978 None] Creating offline snapshot 3a04f39e-cf87-4421-a6c9-099329d3138b of volume 0b52fff3-882e-49ff-883a-c1a820ddb562 {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:07:44 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-8d91ace7-1cf2-4c7e-b579-3fcc551ac12c tempest-CreateVolumesFromSnapshotTest-1245930787 None] Create snapshot completed successfully Apr 16 23:07:44 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3f207c-7eb8-4d78-957b-c49c7e7eb3f4]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:07:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7621f92d-4a02-4609-b68e-64e6698b594d tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:44 devstack sudo[90163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562 Apr 16 23:07:44 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:44 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5e096443-e595-4a03-a85f-72f582487316 tempest-CreateVolumesFromImageTest-68393813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-425e9069-ba88-4784-83d0-f7c0b2706ac0" returned: 0 in 0.590s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:44 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5e096443-e595-4a03-a85f-72f582487316 tempest-CreateVolumesFromImageTest-68393813 None] Lock "cinder-quobyte-425e9069-ba88-4784-83d0-f7c0b2706ac0" released by "delete_volume" :: held 1.225s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:44 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-5e096443-e595-4a03-a85f-72f582487316 tempest-CreateVolumesFromImageTest-68393813 None] Created reservations ['74b2c985-7e06-42dc-aa14-8c00596c5505', 'c4ba6566-c63b-44e3-b28e-d77f4b504fdf', '2a6cef4b-9c0e-4c22-9ed9-4d875b2d74c3', '5b8abbc8-43fe-468d-8b6b-73c81dd823d4'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:07:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5e096443-e595-4a03-a85f-72f582487316 tempest-CreateVolumesFromImageTest-68393813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5e096443-e595-4a03-a85f-72f582487316 tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:44 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5e096443-e595-4a03-a85f-72f582487316 tempest-CreateVolumesFromImageTest-68393813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:44 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5e096443-e595-4a03-a85f-72f582487316 tempest-CreateVolumesFromImageTest-68393813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5e096443-e595-4a03-a85f-72f582487316 tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5e096443-e595-4a03-a85f-72f582487316 tempest-CreateVolumesFromImageTest-68393813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:45 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:07:45 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:07:45 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Flow 'volume_create_manager' (e52f481c-7d63-47b1-9134-972238d0e6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa4b84a-56d3-46d1-a6d8-ff77a58e37a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7621f92d-4a02-4609-b68e-64e6698b594d tempest-VolumeDependencyTests-786286978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562" returned: 0 in 0.732s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7621f92d-4a02-4609-b68e-64e6698b594d tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.3a04f39e-cf87-4421-a6c9-099329d3138b 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fa4b84a-56d3-46d1-a6d8-ff77a58e37a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-238044379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa26562-b06d-4eab-9e6d-7db985ff97de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170268b0c7af46c0bdeecc894470a32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:45Z,use_quota=True,user_id='4f8ac8f7814849e4bd4114944852a269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:45 devstack sudo[90171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.3a04f39e-cf87-4421-a6c9-099329d3138b 1G Apr 16 23:07:45 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df503f90-2951-4b54-8732-ef811dece8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df503f90-2951-4b54-8732-ef811dece8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc36b936-a513-4279-ba8a-7f6cb9234ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc36b936-a513-4279-ba8a-7f6cb9234ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffa26562-b06d-4eab-9e6d-7db985ff97de', 'volume_name': 'volume-ffa26562-b06d-4eab-9e6d-7db985ff97de', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7a8012-43d3-4649-87b5-2e2ddc2ba562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff7a8012-43d3-4649-87b5-2e2ddc2ba562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e34654c1-1e5c-4680-bf51-be66f4a8238b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:45 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Volume ffa26562-b06d-4eab-9e6d-7db985ff97de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffa26562-b06d-4eab-9e6d-7db985ff97de', 'volume_size': 1} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Flow 'volume_create_manager' (196a2e8b-e9c9-46e8-9f9b-2bff291c90ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fcf9428-4914-4555-93f7-7ec3371e86ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fcf9428-4914-4555-93f7-7ec3371e86ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1556904630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d999d3c6-04db-4ba8-a000-b1b7e56b90a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170268b0c7af46c0bdeecc894470a32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:45Z,use_quota=True,user_id='4f8ac8f7814849e4bd4114944852a269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8effdc1-81b0-453c-b7f2-03dab1745fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8effdc1-81b0-453c-b7f2-03dab1745fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7abbac79-06bd-4287-a569-27aca2ae9077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7abbac79-06bd-4287-a569-27aca2ae9077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd999d3c6-04db-4ba8-a000-b1b7e56b90a0', 'volume_name': 'volume-d999d3c6-04db-4ba8-a000-b1b7e56b90a0', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52dad4d-94cf-4807-9f61-9750a71f587c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52dad4d-94cf-4807-9f61-9750a71f587c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9adb8522-eba4-4695-bbdb-17e9e2412a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:45 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Volume d999d3c6-04db-4ba8-a000-b1b7e56b90a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d999d3c6-04db-4ba8-a000-b1b7e56b90a0', 'volume_size': 1} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:45 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5e096443-e595-4a03-a85f-72f582487316 tempest-CreateVolumesFromImageTest-68393813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.816s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-5e096443-e595-4a03-a85f-72f582487316 tempest-CreateVolumesFromImageTest-68393813 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:07:45 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-5e096443-e595-4a03-a85f-72f582487316 tempest-CreateVolumesFromImageTest-68393813 None] Deleted volume successfully. Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-5e096443-e595-4a03-a85f-72f582487316 tempest-CreateVolumesFromImageTest-68393813 None] Lock "cinder-425e9069-ba88-4784-83d0-f7c0b2706ac0-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Flow 'volume_create_manager' (f2d7b3ba-e6f7-4f4c-852d-817a5108b7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8f3bba-6c28-48ec-8d7f-1d61fc4dc0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-684a9dc9-ad36-42d6-8573-9b3d36653d49 tempest-CreateVolumesFromImageTest-68393813 None] Acquiring lock "cinder-cc4a3417-37d7-499b-82e2-4afeab0a27d9-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8f3bba-6c28-48ec-8d7f-1d61fc4dc0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-416542848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed591bd-9e70-4d1c-9227-b95aa278c03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170268b0c7af46c0bdeecc894470a32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:46Z,use_quota=True,user_id='4f8ac8f7814849e4bd4114944852a269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d59c2a-e546-44a0-b100-41b25c02f4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21d59c2a-e546-44a0-b100-41b25c02f4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b848c240-b8b4-43f2-8f56-119e634f2813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b848c240-b8b4-43f2-8f56-119e634f2813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ed591bd-9e70-4d1c-9227-b95aa278c03f', 'volume_name': 'volume-0ed591bd-9e70-4d1c-9227-b95aa278c03f', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ddc6bd-5eda-4712-b02e-ac08d6ddf151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:45 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ddc6bd-5eda-4712-b02e-ac08d6ddf151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3081216b-8a69-4cc5-b852-4004b54c1a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:46 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Volume 0ed591bd-9e70-4d1c-9227-b95aa278c03f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ed591bd-9e70-4d1c-9227-b95aa278c03f', 'volume_size': 1} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-684a9dc9-ad36-42d6-8573-9b3d36653d49 tempest-CreateVolumesFromImageTest-68393813 None] Lock "cinder-cc4a3417-37d7-499b-82e2-4afeab0a27d9-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-684a9dc9-ad36-42d6-8573-9b3d36653d49 tempest-CreateVolumesFromImageTest-68393813 None] Acquiring lock "cinder-quobyte-cc4a3417-37d7-499b-82e2-4afeab0a27d9" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-684a9dc9-ad36-42d6-8573-9b3d36653d49 tempest-CreateVolumesFromImageTest-68393813 None] Lock "cinder-quobyte-cc4a3417-37d7-499b-82e2-4afeab0a27d9" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ead7ca-ac60-4fd2-a117-848676216c8f]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-684a9dc9-ad36-42d6-8573-9b3d36653d49 tempest-CreateVolumesFromImageTest-68393813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-cc4a3417-37d7-499b-82e2-4afeab0a27d9 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:46 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7621f92d-4a02-4609-b68e-64e6698b594d tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.3a04f39e-cf87-4421-a6c9-099329d3138b 1G" returned: 0 in 0.755s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7621f92d-4a02-4609-b68e-64e6698b594d tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b52fff3-882e-49ff-883a-c1a820ddb562 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.3a04f39e-cf87-4421-a6c9-099329d3138b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:46 devstack sudo[90178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b52fff3-882e-49ff-883a-c1a820ddb562 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.3a04f39e-cf87-4421-a6c9-099329d3138b Apr 16 23:07:46 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:46 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-cc4a3417-37d7-499b-82e2-4afeab0a27d9 Apr 16 23:07:46 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Flow 'volume_create_manager' (b5cc2dd3-8d61-4754-a2f8-55024fb854f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4976a77b-46cd-4ae7-8912-0200cb650a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4976a77b-46cd-4ae7-8912-0200cb650a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1136720959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2b839bf-1cda-4591-a1c2-b3fa31c2c359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170268b0c7af46c0bdeecc894470a32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:46Z,use_quota=True,user_id='4f8ac8f7814849e4bd4114944852a269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d16f209-7df5-4709-8d18-c23d11143f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d16f209-7df5-4709-8d18-c23d11143f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a8efb5-6223-4ca0-a747-6effc066d218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20a8efb5-6223-4ca0-a747-6effc066d218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2b839bf-1cda-4591-a1c2-b3fa31c2c359', 'volume_name': 'volume-a2b839bf-1cda-4591-a1c2-b3fa31c2c359', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b223eca-31ad-4fcc-ac39-3b90967c1c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b223eca-31ad-4fcc-ac39-3b90967c1c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f0699a-6f7d-4dfe-9e57-854f7241856f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:46 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Volume a2b839bf-1cda-4591-a1c2-b3fa31c2c359: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2b839bf-1cda-4591-a1c2-b3fa31c2c359', 'volume_size': 1} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Flow 'volume_create_manager' (e0a56da8-915a-4630-82cb-1b5d0eaf162e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e910ebd-ab5f-46a6-97ca-9ac68b83f6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e910ebd-ab5f-46a6-97ca-9ac68b83f6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-560838903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170268b0c7af46c0bdeecc894470a32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:47Z,use_quota=True,user_id='4f8ac8f7814849e4bd4114944852a269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5d3bb7-126d-4590-90c0-610a4ec45293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f5d3bb7-126d-4590-90c0-610a4ec45293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291c3794-cf8a-4781-8123-8232545ec21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (291c3794-cf8a-4781-8123-8232545ec21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e', 'volume_name': 'volume-aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3be280c-33fc-454a-a450-2b8048f1fddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3be280c-33fc-454a-a450-2b8048f1fddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86352b5c-62c4-430a-8cb7-28397d201af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:46 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Volume aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e', 'volume_size': 1} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:46 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-684a9dc9-ad36-42d6-8573-9b3d36653d49 tempest-CreateVolumesFromImageTest-68393813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-cc4a3417-37d7-499b-82e2-4afeab0a27d9" returned: 0 in 0.626s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-684a9dc9-ad36-42d6-8573-9b3d36653d49 tempest-CreateVolumesFromImageTest-68393813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-cc4a3417-37d7-499b-82e2-4afeab0a27d9 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:46 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-cc4a3417-37d7-499b-82e2-4afeab0a27d9 Apr 16 23:07:46 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:46 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7621f92d-4a02-4609-b68e-64e6698b594d tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b52fff3-882e-49ff-883a-c1a820ddb562 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.3a04f39e-cf87-4421-a6c9-099329d3138b" returned: 0 in 0.731s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:46 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-7621f92d-4a02-4609-b68e-64e6698b594d tempest-VolumeDependencyTests-786286978 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.3a04f39e-cf87-4421-a6c9-099329d3138b is being set with open permissions: ugo+rw Apr 16 23:07:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7621f92d-4a02-4609-b68e-64e6698b594d tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.3a04f39e-cf87-4421-a6c9-099329d3138b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:46 devstack sudo[90195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.3a04f39e-cf87-4421-a6c9-099329d3138b Apr 16 23:07:46 devstack sudo[90195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:47 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-684a9dc9-ad36-42d6-8573-9b3d36653d49 tempest-CreateVolumesFromImageTest-68393813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-cc4a3417-37d7-499b-82e2-4afeab0a27d9" returned: 0 in 0.573s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:47 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-684a9dc9-ad36-42d6-8573-9b3d36653d49 tempest-CreateVolumesFromImageTest-68393813 None] Lock "cinder-quobyte-cc4a3417-37d7-499b-82e2-4afeab0a27d9" released by "delete_volume" :: held 1.229s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:47 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-684a9dc9-ad36-42d6-8573-9b3d36653d49 tempest-CreateVolumesFromImageTest-68393813 None] Created reservations ['c96b2d8e-b2b5-4a75-bfe9-edb18e969197', '08495cc2-a6cb-4e7b-bfe3-3e8ecf1c66c0', 'ac4ecbc3-71e9-4a79-92db-3843e66ed798', '4e8fb755-7c52-43c2-8d50-b20d1ac3c147'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:07:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-684a9dc9-ad36-42d6-8573-9b3d36653d49 tempest-CreateVolumesFromImageTest-68393813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-684a9dc9-ad36-42d6-8573-9b3d36653d49 tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:47 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-684a9dc9-ad36-42d6-8573-9b3d36653d49 tempest-CreateVolumesFromImageTest-68393813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:47 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-684a9dc9-ad36-42d6-8573-9b3d36653d49 tempest-CreateVolumesFromImageTest-68393813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-684a9dc9-ad36-42d6-8573-9b3d36653d49 tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-684a9dc9-ad36-42d6-8573-9b3d36653d49 tempest-CreateVolumesFromImageTest-68393813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:47 devstack sudo[90195]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7621f92d-4a02-4609-b68e-64e6698b594d tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.3a04f39e-cf87-4421-a6c9-099329d3138b" returned: 0 in 0.561s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:47 devstack sudo[90199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:07:47 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7621f92d-4a02-4609-b68e-64e6698b594d tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:47 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.info Apr 16 23:07:47 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:47 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7621f92d-4a02-4609-b68e-64e6698b594d tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.info" returned: 0 in 0.482s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:47 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-7621f92d-4a02-4609-b68e-64e6698b594d tempest-VolumeDependencyTests-786286978 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.info is being set with open permissions: ugo+rw Apr 16 23:07:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7621f92d-4a02-4609-b68e-64e6698b594d tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:47 devstack sudo[90205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.info Apr 16 23:07:47 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:47 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-684a9dc9-ad36-42d6-8573-9b3d36653d49 tempest-CreateVolumesFromImageTest-68393813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.587s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:47 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-684a9dc9-ad36-42d6-8573-9b3d36653d49 tempest-CreateVolumesFromImageTest-68393813 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:07:47 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-684a9dc9-ad36-42d6-8573-9b3d36653d49 tempest-CreateVolumesFromImageTest-68393813 None] Deleted volume successfully. Apr 16 23:07:48 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-684a9dc9-ad36-42d6-8573-9b3d36653d49 tempest-CreateVolumesFromImageTest-68393813 None] Lock "cinder-cc4a3417-37d7-499b-82e2-4afeab0a27d9-delete_volume" released by "delete_volume" :: held 1.989s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:48 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7e07a6fd-698d-4704-913b-7e8bc5942511 tempest-CreateVolumesFromImageTest-68393813 None] Acquiring lock "cinder-a5a34929-5492-499a-b210-b8e3f0eb33b6-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:48 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7e07a6fd-698d-4704-913b-7e8bc5942511 tempest-CreateVolumesFromImageTest-68393813 None] Lock "cinder-a5a34929-5492-499a-b210-b8e3f0eb33b6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:48 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7e07a6fd-698d-4704-913b-7e8bc5942511 tempest-CreateVolumesFromImageTest-68393813 None] Acquiring lock "cinder-quobyte-a5a34929-5492-499a-b210-b8e3f0eb33b6" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:48 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7e07a6fd-698d-4704-913b-7e8bc5942511 tempest-CreateVolumesFromImageTest-68393813 None] Lock "cinder-quobyte-a5a34929-5492-499a-b210-b8e3f0eb33b6" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:48 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[da910aca-9f2c-4037-8367-bafb15da1e3e]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:07:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7e07a6fd-698d-4704-913b-7e8bc5942511 tempest-CreateVolumesFromImageTest-68393813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a5a34929-5492-499a-b210-b8e3f0eb33b6 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:48 devstack sudo[90207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a5a34929-5492-499a-b210-b8e3f0eb33b6 Apr 16 23:07:48 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:48 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7621f92d-4a02-4609-b68e-64e6698b594d tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.info" returned: 0 in 0.644s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-7621f92d-4a02-4609-b68e-64e6698b594d tempest-VolumeDependencyTests-786286978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.988s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.146s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:48 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-238044379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffa26562-b06d-4eab-9e6d-7db985ff97de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170268b0c7af46c0bdeecc894470a32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:45Z,use_quota=True,user_id='4f8ac8f7814849e4bd4114944852a269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:07:48 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Creating volume ffa26562-b06d-4eab-9e6d-7db985ff97de {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:07:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:48 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:48 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:48 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:07:48 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:07:48 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ffa26562-b06d-4eab-9e6d-7db985ff97de 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:48 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ffa26562-b06d-4eab-9e6d-7db985ff97de 1073741824 Apr 16 23:07:48 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:48 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-7621f92d-4a02-4609-b68e-64e6698b594d tempest-VolumeDependencyTests-786286978 None] Create snapshot completed successfully Apr 16 23:07:49 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7e07a6fd-698d-4704-913b-7e8bc5942511 tempest-CreateVolumesFromImageTest-68393813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a5a34929-5492-499a-b210-b8e3f0eb33b6" returned: 0 in 0.653s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7e07a6fd-698d-4704-913b-7e8bc5942511 tempest-CreateVolumesFromImageTest-68393813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a5a34929-5492-499a-b210-b8e3f0eb33b6 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:49 devstack sudo[90218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a5a34929-5492-499a-b210-b8e3f0eb33b6 Apr 16 23:07:49 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:49 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ffa26562-b06d-4eab-9e6d-7db985ff97de 1073741824" returned: 0 in 0.599s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ffa26562-b06d-4eab-9e6d-7db985ff97de {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:49 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ffa26562-b06d-4eab-9e6d-7db985ff97de Apr 16 23:07:49 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Flow 'volume_create_manager' (db511fac-9d58-4d97-83e8-58ca258ec09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208b2075-0210-4610-86ab-d29eac905e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (208b2075-0210-4610-86ab-d29eac905e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1304281101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce9e3c32-eb35-44a1-8034-263839e3b0d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf4df9c148bd4fa1ae0acf803397063f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:49Z,use_quota=True,user_id='eb507a4058d046ee806fb8cee1e951bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8774f007-b54e-4cf0-941a-4431e2c8557f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8774f007-b54e-4cf0-941a-4431e2c8557f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (164f61ed-c1fd-4694-9e93-a4d404ab5935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (164f61ed-c1fd-4694-9e93-a4d404ab5935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce9e3c32-eb35-44a1-8034-263839e3b0d2', 'volume_name': 'volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b937320-cc54-43d8-b814-c889e95e6147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b937320-cc54-43d8-b814-c889e95e6147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f3f9b3-8b68-442a-9db7-a3d5af2f2254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:49 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Volume ce9e3c32-eb35-44a1-8034-263839e3b0d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2', 'volume_size': 1} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Flow 'volume_create_manager' (f16ca6bb-2aa3-4dd1-a6c6-37ea7b00994d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8658b6c7-a0b1-4456-a10d-2dfa5498de39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8658b6c7-a0b1-4456-a10d-2dfa5498de39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1154612189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fe6879b-82a8-4eb2-a0bf-5cf747c62195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947f0ee86328495ba7f027f073cfe0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3a04f39e-cf87-4421-a6c9-099329d3138b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:49Z,use_quota=True,user_id='2737acc8e6be4dd49775e6a8b094da56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28745e67-3cfc-4a83-8838-563b6e7c68cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28745e67-3cfc-4a83-8838-563b6e7c68cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72907e57-1f52-4ea2-9e04-8d698c5ee7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72907e57-1f52-4ea2-9e04-8d698c5ee7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3fe6879b-82a8-4eb2-a0bf-5cf747c62195', 'volume_name': 'volume-3fe6879b-82a8-4eb2-a0bf-5cf747c62195', 'volume_size': 1, 'snapshot_id': '3a04f39e-cf87-4421-a6c9-099329d3138b'}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51bd7c47-3454-482e-84dd-f66c47878c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51bd7c47-3454-482e-84dd-f66c47878c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93b7326-4489-4799-a770-2861a180f813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:49 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Volume 3fe6879b-82a8-4eb2-a0bf-5cf747c62195: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3fe6879b-82a8-4eb2-a0bf-5cf747c62195', 'volume_size': 1, 'snapshot_id': '3a04f39e-cf87-4421-a6c9-099329d3138b'} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:49 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7e07a6fd-698d-4704-913b-7e8bc5942511 tempest-CreateVolumesFromImageTest-68393813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a5a34929-5492-499a-b210-b8e3f0eb33b6" returned: 0 in 0.587s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7e07a6fd-698d-4704-913b-7e8bc5942511 tempest-CreateVolumesFromImageTest-68393813 None] Lock "cinder-quobyte-a5a34929-5492-499a-b210-b8e3f0eb33b6" released by "delete_volume" :: held 1.270s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-7e07a6fd-698d-4704-913b-7e8bc5942511 tempest-CreateVolumesFromImageTest-68393813 None] Created reservations ['3d334996-d75e-4c7e-a009-8873095b7809', 'a8781456-ac7a-4a15-8247-577bd46a3386', 'e3ae0e4b-2afc-4795-8c38-b1e05605bb4d', '06b4a65c-5ac0-4c74-ae6d-688fa3f39ae4'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-7e07a6fd-698d-4704-913b-7e8bc5942511 tempest-CreateVolumesFromImageTest-68393813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-7e07a6fd-698d-4704-913b-7e8bc5942511 tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-7e07a6fd-698d-4704-913b-7e8bc5942511 tempest-CreateVolumesFromImageTest-68393813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-7e07a6fd-698d-4704-913b-7e8bc5942511 tempest-CreateVolumesFromImageTest-68393813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-7e07a6fd-698d-4704-913b-7e8bc5942511 tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7e07a6fd-698d-4704-913b-7e8bc5942511 tempest-CreateVolumesFromImageTest-68393813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:49 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:07:49 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:49 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ffa26562-b06d-4eab-9e6d-7db985ff97de" returned: 0 in 0.514s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.136s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1556904630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d999d3c6-04db-4ba8-a000-b1b7e56b90a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170268b0c7af46c0bdeecc894470a32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:45Z,use_quota=True,user_id='4f8ac8f7814849e4bd4114944852a269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Creating volume d999d3c6-04db-4ba8-a000-b1b7e56b90a0 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:07:49 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d999d3c6-04db-4ba8-a000-b1b7e56b90a0 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e34654c1-1e5c-4680-bf51-be66f4a8238b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffa26562-b06d-4eab-9e6d-7db985ff97de', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:49 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d999d3c6-04db-4ba8-a000-b1b7e56b90a0 1073741824 Apr 16 23:07:49 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0768e80a-216c-4ea1-9b92-01d9d0101c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:49 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Volume volume-ffa26562-b06d-4eab-9e6d-7db985ff97de (ffa26562-b06d-4eab-9e6d-7db985ff97de): created successfully Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0768e80a-216c-4ea1-9b92-01d9d0101c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:49 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Flow 'volume_create_manager' (e52f481c-7d63-47b1-9134-972238d0e6a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:49 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-1b011dcc-8646-4583-b8eb-0173667656c9 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Created volume successfully. Apr 16 23:07:50 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-7e07a6fd-698d-4704-913b-7e8bc5942511 tempest-CreateVolumesFromImageTest-68393813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.417s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-7e07a6fd-698d-4704-913b-7e8bc5942511 tempest-CreateVolumesFromImageTest-68393813 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:07:50 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-7e07a6fd-698d-4704-913b-7e8bc5942511 tempest-CreateVolumesFromImageTest-68393813 None] Deleted volume successfully. Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-7e07a6fd-698d-4704-913b-7e8bc5942511 tempest-CreateVolumesFromImageTest-68393813 None] Lock "cinder-a5a34929-5492-499a-b210-b8e3f0eb33b6-delete_volume" released by "delete_volume" :: held 2.013s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bfdcbed5-44a8-41bf-a91f-3bbaeca29f91 tempest-CreateVolumesFromImageTest-68393813 None] Acquiring lock "cinder-d07b44ff-c7b8-48c3-85e6-0706cbdd501c-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bfdcbed5-44a8-41bf-a91f-3bbaeca29f91 tempest-CreateVolumesFromImageTest-68393813 None] Lock "cinder-d07b44ff-c7b8-48c3-85e6-0706cbdd501c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bfdcbed5-44a8-41bf-a91f-3bbaeca29f91 tempest-CreateVolumesFromImageTest-68393813 None] Acquiring lock "cinder-quobyte-d07b44ff-c7b8-48c3-85e6-0706cbdd501c" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:50 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d999d3c6-04db-4ba8-a000-b1b7e56b90a0 1073741824" returned: 0 in 0.595s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bfdcbed5-44a8-41bf-a91f-3bbaeca29f91 tempest-CreateVolumesFromImageTest-68393813 None] Lock "cinder-quobyte-d07b44ff-c7b8-48c3-85e6-0706cbdd501c" acquired by "delete_volume" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a7c6b7-8329-4314-ac20-7e288e3b9a51]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bfdcbed5-44a8-41bf-a91f-3bbaeca29f91 tempest-CreateVolumesFromImageTest-68393813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d07b44ff-c7b8-48c3-85e6-0706cbdd501c {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d999d3c6-04db-4ba8-a000-b1b7e56b90a0 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:50 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d999d3c6-04db-4ba8-a000-b1b7e56b90a0 Apr 16 23:07:50 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:50 devstack sudo[90232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d07b44ff-c7b8-48c3-85e6-0706cbdd501c Apr 16 23:07:50 devstack sudo[90232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:50 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d999d3c6-04db-4ba8-a000-b1b7e56b90a0" returned: 0 in 0.462s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.879s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-416542848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ed591bd-9e70-4d1c-9227-b95aa278c03f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170268b0c7af46c0bdeecc894470a32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:46Z,use_quota=True,user_id='4f8ac8f7814849e4bd4114944852a269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Creating volume 0ed591bd-9e70-4d1c-9227-b95aa278c03f {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:07:50 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0ed591bd-9e70-4d1c-9227-b95aa278c03f 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:50 devstack sudo[90232]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bfdcbed5-44a8-41bf-a91f-3bbaeca29f91 tempest-CreateVolumesFromImageTest-68393813 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d07b44ff-c7b8-48c3-85e6-0706cbdd501c" returned: 0 in 0.515s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bfdcbed5-44a8-41bf-a91f-3bbaeca29f91 tempest-CreateVolumesFromImageTest-68393813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d07b44ff-c7b8-48c3-85e6-0706cbdd501c {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:50 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0ed591bd-9e70-4d1c-9227-b95aa278c03f 1073741824 Apr 16 23:07:50 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9adb8522-eba4-4695-bbdb-17e9e2412a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d999d3c6-04db-4ba8-a000-b1b7e56b90a0', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:50 devstack sudo[90241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d07b44ff-c7b8-48c3-85e6-0706cbdd501c Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3edfd921-1dcc-4133-97bd-e6abf62cf441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:50 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:50 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Volume volume-d999d3c6-04db-4ba8-a000-b1b7e56b90a0 (d999d3c6-04db-4ba8-a000-b1b7e56b90a0): created successfully Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3edfd921-1dcc-4133-97bd-e6abf62cf441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:50 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Flow 'volume_create_manager' (196a2e8b-e9c9-46e8-9f9b-2bff291c90ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:50 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-78644bd5-cb9c-49b5-a344-b638ac3cde14 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Created volume successfully. Apr 16 23:07:51 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bfdcbed5-44a8-41bf-a91f-3bbaeca29f91 tempest-CreateVolumesFromImageTest-68393813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d07b44ff-c7b8-48c3-85e6-0706cbdd501c" returned: 0 in 0.457s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:51 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bfdcbed5-44a8-41bf-a91f-3bbaeca29f91 tempest-CreateVolumesFromImageTest-68393813 None] Lock "cinder-quobyte-d07b44ff-c7b8-48c3-85e6-0706cbdd501c" released by "delete_volume" :: held 1.019s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:51 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-bfdcbed5-44a8-41bf-a91f-3bbaeca29f91 tempest-CreateVolumesFromImageTest-68393813 None] Created reservations ['b8cc38a7-3920-44e6-b3f3-e11167001a0a', '6e82ae3a-0bbe-4fa3-8cd7-ee2a3e995c58', 'd3a18dc1-400d-4eff-9eb5-d6966e59490f', '12f70fd4-98f8-494c-a690-5880e669bd4a'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:07:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bfdcbed5-44a8-41bf-a91f-3bbaeca29f91 tempest-CreateVolumesFromImageTest-68393813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bfdcbed5-44a8-41bf-a91f-3bbaeca29f91 tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:51 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-bfdcbed5-44a8-41bf-a91f-3bbaeca29f91 tempest-CreateVolumesFromImageTest-68393813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:51 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-bfdcbed5-44a8-41bf-a91f-3bbaeca29f91 tempest-CreateVolumesFromImageTest-68393813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bfdcbed5-44a8-41bf-a91f-3bbaeca29f91 tempest-CreateVolumesFromImageTest-68393813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bfdcbed5-44a8-41bf-a91f-3bbaeca29f91 tempest-CreateVolumesFromImageTest-68393813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:51 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:07:51 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:51 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0ed591bd-9e70-4d1c-9227-b95aa278c03f 1073741824" returned: 0 in 0.786s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:51 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0ed591bd-9e70-4d1c-9227-b95aa278c03f {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:51 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0ed591bd-9e70-4d1c-9227-b95aa278c03f Apr 16 23:07:51 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:52 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bfdcbed5-44a8-41bf-a91f-3bbaeca29f91 tempest-CreateVolumesFromImageTest-68393813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.555s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:52 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-bfdcbed5-44a8-41bf-a91f-3bbaeca29f91 tempest-CreateVolumesFromImageTest-68393813 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:07:52 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-bfdcbed5-44a8-41bf-a91f-3bbaeca29f91 tempest-CreateVolumesFromImageTest-68393813 None] Deleted volume successfully. Apr 16 23:07:52 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bfdcbed5-44a8-41bf-a91f-3bbaeca29f91 tempest-CreateVolumesFromImageTest-68393813 None] Lock "cinder-d07b44ff-c7b8-48c3-85e6-0706cbdd501c-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:52 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0ed591bd-9e70-4d1c-9227-b95aa278c03f" returned: 0 in 0.555s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:52 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:07:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.904s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:52 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1136720959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2b839bf-1cda-4591-a1c2-b3fa31c2c359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170268b0c7af46c0bdeecc894470a32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:46Z,use_quota=True,user_id='4f8ac8f7814849e4bd4114944852a269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:07:52 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Creating volume a2b839bf-1cda-4591-a1c2-b3fa31c2c359 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:07:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:52 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:52 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:52 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:07:52 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:07:52 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a2b839bf-1cda-4591-a1c2-b3fa31c2c359 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:52 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3081216b-8a69-4cc5-b852-4004b54c1a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ed591bd-9e70-4d1c-9227-b95aa278c03f', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:52 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a2b839bf-1cda-4591-a1c2-b3fa31c2c359 1073741824 Apr 16 23:07:52 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd842de9-44a1-49a8-8e9b-7aa9ecca8258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:52 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:52 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Volume volume-0ed591bd-9e70-4d1c-9227-b95aa278c03f (0ed591bd-9e70-4d1c-9227-b95aa278c03f): created successfully Apr 16 23:07:52 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd842de9-44a1-49a8-8e9b-7aa9ecca8258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:52 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Flow 'volume_create_manager' (f2d7b3ba-e6f7-4f4c-852d-817a5108b7fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:52 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-dc7fac5f-1683-40b9-a937-e9b374d5328f tempest-CreateVolumesFromSnapshotTest-1245930787 None] Created volume successfully. Apr 16 23:07:53 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a2b839bf-1cda-4591-a1c2-b3fa31c2c359 1073741824" returned: 0 in 0.748s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a2b839bf-1cda-4591-a1c2-b3fa31c2c359 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:53 devstack sudo[90262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a2b839bf-1cda-4591-a1c2-b3fa31c2c359 Apr 16 23:07:53 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:53 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a2b839bf-1cda-4591-a1c2-b3fa31c2c359" returned: 0 in 0.574s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:53 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:07:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:53 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-560838903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170268b0c7af46c0bdeecc894470a32d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:47Z,use_quota=True,user_id='4f8ac8f7814849e4bd4114944852a269',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:07:53 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Creating volume aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:07:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:53 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:53 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:53 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:07:53 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:07:53 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f0699a-6f7d-4dfe-9e57-854f7241856f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2b839bf-1cda-4591-a1c2-b3fa31c2c359', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66104968-5543-46a0-880f-68f10c577711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:53 devstack sudo[90265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e 1073741824 Apr 16 23:07:53 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:53 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Volume volume-a2b839bf-1cda-4591-a1c2-b3fa31c2c359 (a2b839bf-1cda-4591-a1c2-b3fa31c2c359): created successfully Apr 16 23:07:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66104968-5543-46a0-880f-68f10c577711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:53 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Flow 'volume_create_manager' (b5cc2dd3-8d61-4754-a2f8-55024fb854f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:53 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-e012c372-ed48-466f-85bc-7847f41d8abf tempest-CreateVolumesFromSnapshotTest-1245930787 None] Created volume successfully. Apr 16 23:07:54 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e 1073741824" returned: 0 in 0.724s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:54 devstack sudo[90270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e Apr 16 23:07:54 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:54 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e" returned: 0 in 0.598s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:54 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:07:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.637s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:54 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1304281101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce9e3c32-eb35-44a1-8034-263839e3b0d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf4df9c148bd4fa1ae0acf803397063f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:49Z,use_quota=True,user_id='eb507a4058d046ee806fb8cee1e951bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:07:54 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Creating volume ce9e3c32-eb35-44a1-8034-263839e3b0d2 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:07:54 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:07:55 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86352b5c-62c4-430a-8cb7-28397d201af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dedc713-fbfa-4760-81a7-dc09899d9144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:55 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2 1073741824 Apr 16 23:07:55 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:55 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Volume volume-aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e (aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e): created successfully Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dedc713-fbfa-4760-81a7-dc09899d9144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Flow 'volume_create_manager' (e0a56da8-915a-4630-82cb-1b5d0eaf162e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:55 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-8c5fb7c0-3de0-4e7c-8a80-807297d4ff62 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Created volume successfully. Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Flow 'volume_create_manager' (276407f9-375f-4264-bf3e-9eb93efc80c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6cadfe5-96bc-4cd7-b062-b545c066340e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6cadfe5-96bc-4cd7-b062-b545c066340e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2091711701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e515b7f-470d-45e2-bb72-bbcdb2e4f50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='384da5efe68f4fa6a937bb199aeae718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:55Z,use_quota=True,user_id='a5ec6a56d99740699e3557bd98b81b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b053a6-319d-4537-900c-6bdc1891ab92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b053a6-319d-4537-900c-6bdc1891ab92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37fb4ff7-608a-4241-88da-ca2276acf71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37fb4ff7-608a-4241-88da-ca2276acf71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e515b7f-470d-45e2-bb72-bbcdb2e4f50f', 'volume_name': 'volume-3e515b7f-470d-45e2-bb72-bbcdb2e4f50f', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d31dee-78ad-42ed-821d-be1aba66eabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d31dee-78ad-42ed-821d-be1aba66eabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b0b478-aabf-42e8-a895-3f70ad2e4062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:55 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Volume 3e515b7f-470d-45e2-bb72-bbcdb2e4f50f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e515b7f-470d-45e2-bb72-bbcdb2e4f50f', 'volume_size': 1} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-dd7069ea-784e-45ae-ad60-f92196613276 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "cinder-aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-dd7069ea-784e-45ae-ad60-f92196613276 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-dd7069ea-784e-45ae-ad60-f92196613276 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "cinder-quobyte-aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-dd7069ea-784e-45ae-ad60-f92196613276 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-quobyte-aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e" acquired by "delete_volume" :: waited 0.019s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5dbf477-53a2-4ba2-ad48-6fb7f7a092b6]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dd7069ea-784e-45ae-ad60-f92196613276 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:55 devstack sudo[90275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e Apr 16 23:07:55 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:55 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2 1073741824" returned: 0 in 0.640s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:55 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2 Apr 16 23:07:55 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:55 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dd7069ea-784e-45ae-ad60-f92196613276 tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e" returned: 0 in 0.636s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:55 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dd7069ea-784e-45ae-ad60-f92196613276 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:55 devstack sudo[90285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e Apr 16 23:07:55 devstack sudo[90285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:56 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2" returned: 0 in 0.559s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.650s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Acquiring lock "cinder-quobyte-3a04f39e-cf87-4421-a6c9-099329d3138b-3fe6879b-82a8-4eb2-a0bf-5cf747c62195" by "_create_volume_from_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28f3f9b3-8b68-442a-9db7-a3d5af2f2254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (debe62fb-0a44-4677-999b-efaf46b37051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Lock "cinder-quobyte-3a04f39e-cf87-4421-a6c9-099329d3138b-3fe6879b-82a8-4eb2-a0bf-5cf747c62195" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Creating volume 3fe6879b-82a8-4eb2-a0bf-5cf747c62195 from snapshot 3a04f39e-cf87-4421-a6c9-099329d3138b {{(pid=81971) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Acquiring lock "cinder-quobyte-3fe6879b-82a8-4eb2-a0bf-5cf747c62195" by "_copy_volume_from_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:56 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Volume volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2 (ce9e3c32-eb35-44a1-8034-263839e3b0d2): created successfully Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (debe62fb-0a44-4677-999b-efaf46b37051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Flow 'volume_create_manager' (db511fac-9d58-4d97-83e8-58ca258ec09a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Lock "cinder-quobyte-3fe6879b-82a8-4eb2-a0bf-5cf747c62195" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] snapshot: 3a04f39e-cf87-4421-a6c9-099329d3138b, volume: 3fe6879b-82a8-4eb2-a0bf-5cf747c62195, {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 23:07:56 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-701fff71-fefa-4cfa-bed8-409955d95c8b tempest-SnapshotDependencyTests-854076519 None] Created volume successfully. Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c0776b-44a8-4ecf-bff2-b380d413e815]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.3a04f39e-cf87-4421-a6c9-099329d3138b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:56 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.3a04f39e-cf87-4421-a6c9-099329d3138b Apr 16 23:07:56 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:56 devstack sudo[90285]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dd7069ea-784e-45ae-ad60-f92196613276 tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e" returned: 0 in 0.560s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-dd7069ea-784e-45ae-ad60-f92196613276 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-quobyte-aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e" released by "delete_volume" :: held 1.222s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-dd7069ea-784e-45ae-ad60-f92196613276 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Created reservations ['5f94a0f6-e226-45b2-a5db-a3b176a98f97', '91914c96-43af-44bc-b151-6de1c9f6db5c', '7d2e8aef-6002-4ec6-8dea-8959da6802a9', '5f5fac44-5e53-4ea2-9232-f7152fb404ef'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-dd7069ea-784e-45ae-ad60-f92196613276 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-dd7069ea-784e-45ae-ad60-f92196613276 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-dd7069ea-784e-45ae-ad60-f92196613276 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-dd7069ea-784e-45ae-ad60-f92196613276 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-dd7069ea-784e-45ae-ad60-f92196613276 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dd7069ea-784e-45ae-ad60-f92196613276 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:56 devstack sudo[90291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:07:56 devstack sudo[90291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:56 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0620e776-ba3f-4134-aa36-1bc00a441c95 tempest-SnapshotDependencyTests-854076519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:57 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.3a04f39e-cf87-4421-a6c9-099329d3138b" returned: 0 in 0.655s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b52fff3-882e-49ff-883a-c1a820ddb562(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:07:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562 {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 23:07:57 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Creating direct copy from snapshot {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 23:07:57 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[4006ad9d-e0ee-4529-80cc-9240a635e9e6]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:07:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:57 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562 Apr 16 23:07:57 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:57 devstack sudo[90291]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dd7069ea-784e-45ae-ad60-f92196613276 tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.581s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:57 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-dd7069ea-784e-45ae-ad60-f92196613276 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:07:57 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-dd7069ea-784e-45ae-ad60-f92196613276 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Deleted volume successfully. Apr 16 23:07:57 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-dd7069ea-784e-45ae-ad60-f92196613276 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-aa2f2657-fbbd-42d7-8317-b4ebf2bb1b1e-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:57 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-79c6242b-bc9e-4f31-acad-e5483cd3b7a3 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "cinder-a2b839bf-1cda-4591-a1c2-b3fa31c2c359-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:57 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-79c6242b-bc9e-4f31-acad-e5483cd3b7a3 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-a2b839bf-1cda-4591-a1c2-b3fa31c2c359-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:57 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-79c6242b-bc9e-4f31-acad-e5483cd3b7a3 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "cinder-quobyte-a2b839bf-1cda-4591-a1c2-b3fa31c2c359" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:57 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-79c6242b-bc9e-4f31-acad-e5483cd3b7a3 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-quobyte-a2b839bf-1cda-4591-a1c2-b3fa31c2c359" acquired by "delete_volume" :: waited 0.020s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:07:57 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[f926438a-fe09-4a00-b94a-b755f440631e]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:07:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-79c6242b-bc9e-4f31-acad-e5483cd3b7a3 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a2b839bf-1cda-4591-a1c2-b3fa31c2c359 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:57 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a2b839bf-1cda-4591-a1c2-b3fa31c2c359 Apr 16 23:07:57 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:57 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562" returned: 0 in 0.648s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:57 devstack cinder-volume[81971]: DEBUG cinder.utils [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Path /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3fe6879b-82a8-4eb2-a0bf-5cf747c62195 not found in is_blk_device check {{(pid=81971) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 23:07:57 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3fe6879b-82a8-4eb2-a0bf-5cf747c62195 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:57 devstack sudo[90304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3fe6879b-82a8-4eb2-a0bf-5cf747c62195 Apr 16 23:07:57 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:58 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-79c6242b-bc9e-4f31-acad-e5483cd3b7a3 tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a2b839bf-1cda-4591-a1c2-b3fa31c2c359" returned: 0 in 0.640s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:58 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-79c6242b-bc9e-4f31-acad-e5483cd3b7a3 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a2b839bf-1cda-4591-a1c2-b3fa31c2c359 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:58 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a2b839bf-1cda-4591-a1c2-b3fa31c2c359 Apr 16 23:07:58 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:59 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Apr 16 23:07:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-79c6242b-bc9e-4f31-acad-e5483cd3b7a3 tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-a2b839bf-1cda-4591-a1c2-b3fa31c2c359" returned: 0 in 0.873s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:07:59 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-79c6242b-bc9e-4f31-acad-e5483cd3b7a3 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-quobyte-a2b839bf-1cda-4591-a1c2-b3fa31c2c359" released by "delete_volume" :: held 1.545s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:07:59 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-79c6242b-bc9e-4f31-acad-e5483cd3b7a3 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Created reservations ['968165c1-0751-4d2a-bf80-4d11ffe95ef9', '63896d2d-b899-4424-9eb8-e13c8d20414e', '085f8527-56e9-4a48-8000-d60c260fd765', 'aaf63c0f-1aaa-48ce-a589-41b6ea9167dc'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:07:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-79c6242b-bc9e-4f31-acad-e5483cd3b7a3 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:07:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-79c6242b-bc9e-4f31-acad-e5483cd3b7a3 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:07:59 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-79c6242b-bc9e-4f31-acad-e5483cd3b7a3 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:07:59 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-79c6242b-bc9e-4f31-acad-e5483cd3b7a3 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:07:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-79c6242b-bc9e-4f31-acad-e5483cd3b7a3 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:07:59 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-79c6242b-bc9e-4f31-acad-e5483cd3b7a3 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:07:59 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:07:59 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:07:59 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6c29d8d6-3008-4dbe-9ed8-bc0db70e900e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "cinder-0ed591bd-9e70-4d1c-9227-b95aa278c03f-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:07:59 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6c29d8d6-3008-4dbe-9ed8-bc0db70e900e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-0ed591bd-9e70-4d1c-9227-b95aa278c03f-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6c29d8d6-3008-4dbe-9ed8-bc0db70e900e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "cinder-quobyte-0ed591bd-9e70-4d1c-9227-b95aa278c03f" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6c29d8d6-3008-4dbe-9ed8-bc0db70e900e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-quobyte-0ed591bd-9e70-4d1c-9227-b95aa278c03f" acquired by "delete_volume" :: waited 0.025s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:00 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e6ce46-c88d-4e1a-bbeb-e56e168109f3]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6c29d8d6-3008-4dbe-9ed8-bc0db70e900e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0ed591bd-9e70-4d1c-9227-b95aa278c03f {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:00 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0ed591bd-9e70-4d1c-9227-b95aa278c03f Apr 16 23:08:00 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:00 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3fe6879b-82a8-4eb2-a0bf-5cf747c62195" returned: 0 in 2.656s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:00 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c0933c-2746-4411-b002-5fb107df5da8]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:00 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562 Apr 16 23:08:00 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:00 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-79c6242b-bc9e-4f31-acad-e5483cd3b7a3 tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 1.039s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:00 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-79c6242b-bc9e-4f31-acad-e5483cd3b7a3 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:08:00 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-79c6242b-bc9e-4f31-acad-e5483cd3b7a3 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Deleted volume successfully. Apr 16 23:08:00 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-79c6242b-bc9e-4f31-acad-e5483cd3b7a3 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-a2b839bf-1cda-4591-a1c2-b3fa31c2c359-delete_volume" released by "delete_volume" :: held 3.090s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:00 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6c29d8d6-3008-4dbe-9ed8-bc0db70e900e tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0ed591bd-9e70-4d1c-9227-b95aa278c03f" returned: 0 in 0.642s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:00 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6c29d8d6-3008-4dbe-9ed8-bc0db70e900e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0ed591bd-9e70-4d1c-9227-b95aa278c03f {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:00 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0ed591bd-9e70-4d1c-9227-b95aa278c03f Apr 16 23:08:00 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:01 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562" returned: 0 in 0.733s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Image conversion details: src /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562, size 1024.00 MB, duration 2.66 sec, destination /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3fe6879b-82a8-4eb2-a0bf-5cf747c62195 {{(pid=81971) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 23:08:01 devstack cinder-volume[81971]: INFO cinder.image.image_utils [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Converted 1024.00 MB image at 385.41 MB/s Apr 16 23:08:01 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3fe6879b-82a8-4eb2-a0bf-5cf747c62195 is being set with open permissions: ugo+rw Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3fe6879b-82a8-4eb2-a0bf-5cf747c62195 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:01 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3fe6879b-82a8-4eb2-a0bf-5cf747c62195 Apr 16 23:08:01 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:01 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6c29d8d6-3008-4dbe-9ed8-bc0db70e900e tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0ed591bd-9e70-4d1c-9227-b95aa278c03f" returned: 0 in 0.493s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6c29d8d6-3008-4dbe-9ed8-bc0db70e900e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-quobyte-0ed591bd-9e70-4d1c-9227-b95aa278c03f" released by "delete_volume" :: held 1.188s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-6c29d8d6-3008-4dbe-9ed8-bc0db70e900e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Created reservations ['87491202-aafc-47dd-9f35-fff667361866', '9828a927-6c36-4350-8705-779d7174f3d1', 'eb4b78f8-c328-4766-a8f0-e496a8f26313', 'f66adc8c-a408-4419-b374-2164d0c078aa'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6c29d8d6-3008-4dbe-9ed8-bc0db70e900e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6c29d8d6-3008-4dbe-9ed8-bc0db70e900e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-6c29d8d6-3008-4dbe-9ed8-bc0db70e900e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-6c29d8d6-3008-4dbe-9ed8-bc0db70e900e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-6c29d8d6-3008-4dbe-9ed8-bc0db70e900e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6c29d8d6-3008-4dbe-9ed8-bc0db70e900e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:01 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:08:01 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:01 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3fe6879b-82a8-4eb2-a0bf-5cf747c62195" returned: 0 in 0.605s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Lock "cinder-quobyte-3fe6879b-82a8-4eb2-a0bf-5cf747c62195" released by "_copy_volume_from_snapshot" :: held 5.400s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Lock "cinder-quobyte-3a04f39e-cf87-4421-a6c9-099329d3138b-3fe6879b-82a8-4eb2-a0bf-5cf747c62195" released by "_create_volume_from_snapshot" :: held 5.438s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.465s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.515s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2091711701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e515b7f-470d-45e2-bb72-bbcdb2e4f50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='384da5efe68f4fa6a937bb199aeae718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:07:55Z,use_quota=True,user_id='a5ec6a56d99740699e3557bd98b81b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Creating volume 3e515b7f-470d-45e2-bb72-bbcdb2e4f50f {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:08:01 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3e515b7f-470d-45e2-bb72-bbcdb2e4f50f 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:01 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3e515b7f-470d-45e2-bb72-bbcdb2e4f50f 1073741824 Apr 16 23:08:01 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e93b7326-4489-4799-a770-2861a180f813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fe6879b-82a8-4eb2-a0bf-5cf747c62195', 'volume_size': 1, 'snapshot_id': '3a04f39e-cf87-4421-a6c9-099329d3138b'}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab8f97c-df00-49fc-b8c8-3814ea3d90b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:01 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Volume volume-3fe6879b-82a8-4eb2-a0bf-5cf747c62195 (3fe6879b-82a8-4eb2-a0bf-5cf747c62195): created successfully Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab8f97c-df00-49fc-b8c8-3814ea3d90b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Flow 'volume_create_manager' (f16ca6bb-2aa3-4dd1-a6c6-37ea7b00994d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:08:01 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-85f433e0-d461-47cf-a116-f32652616d66 tempest-VolumeDependencyTests-786286978 None] Created volume successfully. Apr 16 23:08:01 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6c29d8d6-3008-4dbe-9ed8-bc0db70e900e tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.501s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-6c29d8d6-3008-4dbe-9ed8-bc0db70e900e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:08:01 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-6c29d8d6-3008-4dbe-9ed8-bc0db70e900e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Deleted volume successfully. Apr 16 23:08:01 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6c29d8d6-3008-4dbe-9ed8-bc0db70e900e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-0ed591bd-9e70-4d1c-9227-b95aa278c03f-delete_volume" released by "delete_volume" :: held 2.004s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bbf4d7ae-3a6e-4622-becf-8a9012f90565 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "cinder-d999d3c6-04db-4ba8-a000-b1b7e56b90a0-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bbf4d7ae-3a6e-4622-becf-8a9012f90565 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-d999d3c6-04db-4ba8-a000-b1b7e56b90a0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bbf4d7ae-3a6e-4622-becf-8a9012f90565 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "cinder-quobyte-d999d3c6-04db-4ba8-a000-b1b7e56b90a0" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bbf4d7ae-3a6e-4622-becf-8a9012f90565 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-quobyte-d999d3c6-04db-4ba8-a000-b1b7e56b90a0" acquired by "delete_volume" :: waited 0.015s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8f8858-159f-4878-b1b1-ddc256cc5913]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bbf4d7ae-3a6e-4622-becf-8a9012f90565 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d999d3c6-04db-4ba8-a000-b1b7e56b90a0 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:02 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d999d3c6-04db-4ba8-a000-b1b7e56b90a0 Apr 16 23:08:02 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:02 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3e515b7f-470d-45e2-bb72-bbcdb2e4f50f 1073741824" returned: 0 in 0.667s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3e515b7f-470d-45e2-bb72-bbcdb2e4f50f {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-85bdaf1a-e18b-40b7-b618-ea8508faa70d tempest-VolumeDependencyTests-786286978 None] Acquiring lock "cinder-3a04f39e-cf87-4421-a6c9-099329d3138b-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:02 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3e515b7f-470d-45e2-bb72-bbcdb2e4f50f Apr 16 23:08:02 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-85bdaf1a-e18b-40b7-b618-ea8508faa70d tempest-VolumeDependencyTests-786286978 None] Lock "cinder-3a04f39e-cf87-4421-a6c9-099329d3138b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-85bdaf1a-e18b-40b7-b618-ea8508faa70d tempest-VolumeDependencyTests-786286978 None] Acquiring lock "cinder-quobyte-0b52fff3-882e-49ff-883a-c1a820ddb562" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-85bdaf1a-e18b-40b7-b618-ea8508faa70d tempest-VolumeDependencyTests-786286978 None] Lock "cinder-quobyte-0b52fff3-882e-49ff-883a-c1a820ddb562" acquired by "delete_snapshot" :: waited 0.009s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-85bdaf1a-e18b-40b7-b618-ea8508faa70d tempest-VolumeDependencyTests-786286978 None] Acquiring lock "cinder-quobyte-3a04f39e-cf87-4421-a6c9-099329d3138b" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-85bdaf1a-e18b-40b7-b618-ea8508faa70d tempest-VolumeDependencyTests-786286978 None] Lock "cinder-quobyte-3a04f39e-cf87-4421-a6c9-099329d3138b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-85bdaf1a-e18b-40b7-b618-ea8508faa70d tempest-VolumeDependencyTests-786286978 None] Deleting offline snapshot 3a04f39e-cf87-4421-a6c9-099329d3138b of volume 0b52fff3-882e-49ff-883a-c1a820ddb562 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-85bdaf1a-e18b-40b7-b618-ea8508faa70d tempest-VolumeDependencyTests-786286978 None] snapshot_file for this snap is: volume-0b52fff3-882e-49ff-883a-c1a820ddb562.3a04f39e-cf87-4421-a6c9-099329d3138b {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e66aa3a-f613-40d4-9abf-f0a43f22d522]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-85bdaf1a-e18b-40b7-b618-ea8508faa70d tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.3a04f39e-cf87-4421-a6c9-099329d3138b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:02 devstack sudo[90388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.3a04f39e-cf87-4421-a6c9-099329d3138b Apr 16 23:08:02 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:02 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3e515b7f-470d-45e2-bb72-bbcdb2e4f50f" returned: 0 in 0.480s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0620e776-ba3f-4134-aa36-1bc00a441c95 tempest-SnapshotDependencyTests-854076519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.974s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b0b478-aabf-42e8-a895-3f70ad2e4062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e515b7f-470d-45e2-bb72-bbcdb2e4f50f', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3506b423-ad4c-459c-824c-69df6bfa9faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:02 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-0620e776-ba3f-4134-aa36-1bc00a441c95 tempest-SnapshotDependencyTests-854076519 None] Creating offline snapshot ef450517-f0d2-444f-b4aa-a4585c117787 of volume ce9e3c32-eb35-44a1-8034-263839e3b0d2 {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bbf4d7ae-3a6e-4622-becf-8a9012f90565 tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d999d3c6-04db-4ba8-a000-b1b7e56b90a0" returned: 0 in 0.660s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bbf4d7ae-3a6e-4622-becf-8a9012f90565 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d999d3c6-04db-4ba8-a000-b1b7e56b90a0 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[64db3802-35d1-48fd-8d68-9159b02957c2]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0620e776-ba3f-4134-aa36-1bc00a441c95 tempest-SnapshotDependencyTests-854076519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:02 devstack sudo[90396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d999d3c6-04db-4ba8-a000-b1b7e56b90a0 Apr 16 23:08:02 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:02 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Volume volume-3e515b7f-470d-45e2-bb72-bbcdb2e4f50f (3e515b7f-470d-45e2-bb72-bbcdb2e4f50f): created successfully Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3506b423-ad4c-459c-824c-69df6bfa9faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:02 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Flow 'volume_create_manager' (276407f9-375f-4264-bf3e-9eb93efc80c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:08:03 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-b339a920-d022-4b7d-9ae3-294f0ca66535 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Created volume successfully. Apr 16 23:08:03 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2 Apr 16 23:08:03 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:03 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-85bdaf1a-e18b-40b7-b618-ea8508faa70d tempest-VolumeDependencyTests-786286978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.3a04f39e-cf87-4421-a6c9-099329d3138b" returned: 0 in 0.561s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-85bdaf1a-e18b-40b7-b618-ea8508faa70d tempest-VolumeDependencyTests-786286978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b52fff3-882e-49ff-883a-c1a820ddb562(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:08:03 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b00db2-8cca-4253-884b-d3e1c43f0319]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-85bdaf1a-e18b-40b7-b618-ea8508faa70d tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:03 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562 Apr 16 23:08:03 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:03 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bbf4d7ae-3a6e-4622-becf-8a9012f90565 tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-d999d3c6-04db-4ba8-a000-b1b7e56b90a0" returned: 0 in 0.521s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:03 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bbf4d7ae-3a6e-4622-becf-8a9012f90565 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-quobyte-d999d3c6-04db-4ba8-a000-b1b7e56b90a0" released by "delete_volume" :: held 1.217s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:03 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0620e776-ba3f-4134-aa36-1bc00a441c95 tempest-SnapshotDependencyTests-854076519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2" returned: 0 in 0.539s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0620e776-ba3f-4134-aa36-1bc00a441c95 tempest-SnapshotDependencyTests-854076519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.ef450517-f0d2-444f-b4aa-a4585c117787 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:03 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.ef450517-f0d2-444f-b4aa-a4585c117787 1G Apr 16 23:08:03 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:03 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-bbf4d7ae-3a6e-4622-becf-8a9012f90565 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Created reservations ['0d6d514b-0ad6-44d1-94b4-728c64f9e3e8', '9ea63496-b642-4777-9aed-b645c182e303', '23ca4c4e-0b53-487a-90bc-835f656989f2', 'ce7696ee-c9d4-41a3-9bc7-9b6e213932a1'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:08:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bbf4d7ae-3a6e-4622-becf-8a9012f90565 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bbf4d7ae-3a6e-4622-becf-8a9012f90565 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-bbf4d7ae-3a6e-4622-becf-8a9012f90565 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:03 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-bbf4d7ae-3a6e-4622-becf-8a9012f90565 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-bbf4d7ae-3a6e-4622-becf-8a9012f90565 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bbf4d7ae-3a6e-4622-becf-8a9012f90565 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:03 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:08:03 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:03 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-85bdaf1a-e18b-40b7-b618-ea8508faa70d tempest-VolumeDependencyTests-786286978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562" returned: 0 in 0.625s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:03 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-85bdaf1a-e18b-40b7-b618-ea8508faa70d tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.3a04f39e-cf87-4421-a6c9-099329d3138b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:03 devstack sudo[90414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.3a04f39e-cf87-4421-a6c9-099329d3138b Apr 16 23:08:03 devstack sudo[90414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:03 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:08:03 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Flow 'volume_create_manager' (c50e3d04-79e5-4e79-bf79-312498c583c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32520bd-35a1-4055-a007-c66bf5670cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b32520bd-35a1-4055-a007-c66bf5670cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-370326729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb67679-3d15-4235-848c-f3e850ab12c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='384da5efe68f4fa6a937bb199aeae718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:08:04Z,use_quota=True,user_id='a5ec6a56d99740699e3557bd98b81b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df60f352-78c8-4e51-b459-7a583c0453d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df60f352-78c8-4e51-b459-7a583c0453d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e360cf9-4c6b-42fc-b0a8-dda5575ae6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e360cf9-4c6b-42fc-b0a8-dda5575ae6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bb67679-3d15-4235-848c-f3e850ab12c9', 'volume_name': 'volume-9bb67679-3d15-4235-848c-f3e850ab12c9', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6287169-4815-4836-b087-481389d781e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6287169-4815-4836-b087-481389d781e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a667641e-3565-492e-9f53-030e854148b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:04 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Volume 9bb67679-3d15-4235-848c-f3e850ab12c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bb67679-3d15-4235-848c-f3e850ab12c9', 'volume_size': 1} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:04 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0620e776-ba3f-4134-aa36-1bc00a441c95 tempest-SnapshotDependencyTests-854076519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.ef450517-f0d2-444f-b4aa-a4585c117787 1G" returned: 0 in 0.652s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0620e776-ba3f-4134-aa36-1bc00a441c95 tempest-SnapshotDependencyTests-854076519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.ef450517-f0d2-444f-b4aa-a4585c117787 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:04 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.ef450517-f0d2-444f-b4aa-a4585c117787 Apr 16 23:08:04 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Flow 'volume_create_manager' (e138365a-7818-4bf9-887d-c5f2b3e1841b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12fc1850-c4bb-434b-98ee-649077aafbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12fc1850-c4bb-434b-98ee-649077aafbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-736335865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce47187d-565f-4c34-82bd-5874e5d1ede3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='384da5efe68f4fa6a937bb199aeae718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:08:04Z,use_quota=True,user_id='a5ec6a56d99740699e3557bd98b81b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a148533-ecf2-40ea-b537-18f3247bb381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:04 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a148533-ecf2-40ea-b537-18f3247bb381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572f57e2-ab09-475c-9d44-e5173510c2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (572f57e2-ab09-475c-9d44-e5173510c2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce47187d-565f-4c34-82bd-5874e5d1ede3', 'volume_name': 'volume-ce47187d-565f-4c34-82bd-5874e5d1ede3', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9c6cb7-6069-47a4-8b5c-e77679e8313f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9c6cb7-6069-47a4-8b5c-e77679e8313f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71922265-a544-4dda-95a4-a18a1b35599b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:04 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Volume ce47187d-565f-4c34-82bd-5874e5d1ede3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce47187d-565f-4c34-82bd-5874e5d1ede3', 'volume_size': 1} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-bbf4d7ae-3a6e-4622-becf-8a9012f90565 tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.756s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-bbf4d7ae-3a6e-4622-becf-8a9012f90565 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-95c36941-a003-4b2b-b8cb-533638acd80e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "cinder-ffa26562-b06d-4eab-9e6d-7db985ff97de-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:04 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-bbf4d7ae-3a6e-4622-becf-8a9012f90565 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Deleted volume successfully. Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-95c36941-a003-4b2b-b8cb-533638acd80e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-ffa26562-b06d-4eab-9e6d-7db985ff97de-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-bbf4d7ae-3a6e-4622-becf-8a9012f90565 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-d999d3c6-04db-4ba8-a000-b1b7e56b90a0-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-95c36941-a003-4b2b-b8cb-533638acd80e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "cinder-quobyte-ffa26562-b06d-4eab-9e6d-7db985ff97de" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-95c36941-a003-4b2b-b8cb-533638acd80e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-quobyte-ffa26562-b06d-4eab-9e6d-7db985ff97de" acquired by "delete_volume" :: waited 0.018s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[b498c134-6944-486b-bb7b-e4935fcb39af]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-95c36941-a003-4b2b-b8cb-533638acd80e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ffa26562-b06d-4eab-9e6d-7db985ff97de {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:04 devstack sudo[90414]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-85bdaf1a-e18b-40b7-b618-ea8508faa70d tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.3a04f39e-cf87-4421-a6c9-099329d3138b" returned: 0 in 0.901s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-85bdaf1a-e18b-40b7-b618-ea8508faa70d tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.3a04f39e-cf87-4421-a6c9-099329d3138b {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:04 devstack sudo[90426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.3a04f39e-cf87-4421-a6c9-099329d3138b Apr 16 23:08:04 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ffa26562-b06d-4eab-9e6d-7db985ff97de Apr 16 23:08:04 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:04 devstack sudo[90426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Flow 'volume_create_manager' (9eef183b-ddd3-44ea-92ac-8c7f8d1386de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ad1b70-2806-4985-9dae-1830a5106269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ad1b70-2806-4985-9dae-1830a5106269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1987781933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49445796-0c25-4a73-8f78-fcb22be8c324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='384da5efe68f4fa6a937bb199aeae718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:08:05Z,use_quota=True,user_id='a5ec6a56d99740699e3557bd98b81b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c4999a-be57-4a1e-8ef1-9e58e66ed3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17c4999a-be57-4a1e-8ef1-9e58e66ed3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e554d36-7734-4fe9-b10d-3d9a9601d01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e554d36-7734-4fe9-b10d-3d9a9601d01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49445796-0c25-4a73-8f78-fcb22be8c324', 'volume_name': 'volume-49445796-0c25-4a73-8f78-fcb22be8c324', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c6c7ced-f297-4b40-9a43-57765d950f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c6c7ced-f297-4b40-9a43-57765d950f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccac53b6-9716-4493-a813-2e22a93ac200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:04 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Volume 49445796-0c25-4a73-8f78-fcb22be8c324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49445796-0c25-4a73-8f78-fcb22be8c324', 'volume_size': 1} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG oslo_service.periodic_task [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81971) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:04 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:08:04 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:04 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0620e776-ba3f-4134-aa36-1bc00a441c95 tempest-SnapshotDependencyTests-854076519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.ef450517-f0d2-444f-b4aa-a4585c117787" returned: 0 in 0.734s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:04 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-0620e776-ba3f-4134-aa36-1bc00a441c95 tempest-SnapshotDependencyTests-854076519 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.ef450517-f0d2-444f-b4aa-a4585c117787 is being set with open permissions: ugo+rw Apr 16 23:08:04 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0620e776-ba3f-4134-aa36-1bc00a441c95 tempest-SnapshotDependencyTests-854076519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.ef450517-f0d2-444f-b4aa-a4585c117787 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:04 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.ef450517-f0d2-444f-b4aa-a4585c117787 Apr 16 23:08:04 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Flow 'volume_create_manager' (0504a7e0-3866-4176-8ce2-3d3e015bf215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca81df2-e409-49d6-9015-5f5e5381a0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca81df2-e409-49d6-9015-5f5e5381a0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1374967332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8b841b-745a-4903-8a53-848fd3a6b6fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='384da5efe68f4fa6a937bb199aeae718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:08:05Z,use_quota=True,user_id='a5ec6a56d99740699e3557bd98b81b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68391256-a2c7-4c60-a665-b050762ad5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68391256-a2c7-4c60-a665-b050762ad5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea03cd7f-ea21-41cd-a5d0-4a099472bd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea03cd7f-ea21-41cd-a5d0-4a099472bd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d8b841b-745a-4903-8a53-848fd3a6b6fe', 'volume_name': 'volume-0d8b841b-745a-4903-8a53-848fd3a6b6fe', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a238cc32-d50e-4c38-aabf-d2be7cac57a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a238cc32-d50e-4c38-aabf-d2be7cac57a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe657af-e70a-49f8-aea3-9052ad4d365e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:05 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Volume 0d8b841b-745a-4903-8a53-848fd3a6b6fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d8b841b-745a-4903-8a53-848fd3a6b6fe', 'volume_size': 1} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:05 devstack sudo[90426]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-85bdaf1a-e18b-40b7-b618-ea8508faa70d tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562.3a04f39e-cf87-4421-a6c9-099329d3138b" returned: 0 in 0.717s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Flow 'volume_create_manager' (1d3cb55c-92f4-48de-a9f5-eb80b062a20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6094f90-31a2-45d7-965b-33dfaa04ab8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6094f90-31a2-45d7-965b-33dfaa04ab8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1752630426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77fa1816-ceda-4d98-8ffc-478ebde1dc3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='384da5efe68f4fa6a937bb199aeae718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:08:05Z,use_quota=True,user_id='a5ec6a56d99740699e3557bd98b81b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (644bf08e-4b5b-4783-8d74-53b620d21a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (644bf08e-4b5b-4783-8d74-53b620d21a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10776ac-cfd5-44a6-b291-e82cc53a2619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:05 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10776ac-cfd5-44a6-b291-e82cc53a2619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77fa1816-ceda-4d98-8ffc-478ebde1dc3e', 'volume_name': 'volume-77fa1816-ceda-4d98-8ffc-478ebde1dc3e', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd3379b1-947a-4e76-826a-5a232ed95752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd3379b1-947a-4e76-826a-5a232ed95752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (716ad4fa-adbe-435b-bbe3-4b4a83b62bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:05 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Volume 77fa1816-ceda-4d98-8ffc-478ebde1dc3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77fa1816-ceda-4d98-8ffc-478ebde1dc3e', 'volume_size': 1} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-95c36941-a003-4b2b-b8cb-533638acd80e tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ffa26562-b06d-4eab-9e6d-7db985ff97de" returned: 0 in 0.886s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-95c36941-a003-4b2b-b8cb-533638acd80e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ffa26562-b06d-4eab-9e6d-7db985ff97de {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-85bdaf1a-e18b-40b7-b618-ea8508faa70d tempest-VolumeDependencyTests-786286978 None] Lock "cinder-quobyte-3a04f39e-cf87-4421-a6c9-099329d3138b" released by "_delete_snapshot" :: held 2.944s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-85bdaf1a-e18b-40b7-b618-ea8508faa70d tempest-VolumeDependencyTests-786286978 None] Lock "cinder-quobyte-0b52fff3-882e-49ff-883a-c1a820ddb562" released by "delete_snapshot" :: held 2.964s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:05 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ffa26562-b06d-4eab-9e6d-7db985ff97de Apr 16 23:08:05 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-85bdaf1a-e18b-40b7-b618-ea8508faa70d tempest-VolumeDependencyTests-786286978 None] Created reservations ['d5cbd79c-9afd-42f9-b084-ded6fa4c22a5', 'a610389f-ac84-4d18-93fe-878cfae2cc37', '85eb3ce6-b3ef-4140-8520-06cd80d056f5', '270fe908-4c85-447e-9b5f-b7f609770dd3'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:08:05 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-85bdaf1a-e18b-40b7-b618-ea8508faa70d tempest-VolumeDependencyTests-786286978 None] Delete snapshot completed successfully. Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-85bdaf1a-e18b-40b7-b618-ea8508faa70d tempest-VolumeDependencyTests-786286978 None] Lock "cinder-3a04f39e-cf87-4421-a6c9-099329d3138b-delete_snapshot" released by "delete_snapshot" :: held 3.073s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:05 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d01e41b3-7092-406b-942b-ce2711aaf85f tempest-VolumeDependencyTests-786286978 None] Acquiring lock "cinder-0b52fff3-882e-49ff-883a-c1a820ddb562-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.811s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:05 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-77d81e41-d006-48b9-a7c3-a4caf780b6f5 None None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d01e41b3-7092-406b-942b-ce2711aaf85f tempest-VolumeDependencyTests-786286978 None] Lock "cinder-0b52fff3-882e-49ff-883a-c1a820ddb562-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0620e776-ba3f-4134-aa36-1bc00a441c95 tempest-SnapshotDependencyTests-854076519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.ef450517-f0d2-444f-b4aa-a4585c117787" returned: 0 in 0.756s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0620e776-ba3f-4134-aa36-1bc00a441c95 tempest-SnapshotDependencyTests-854076519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d01e41b3-7092-406b-942b-ce2711aaf85f tempest-VolumeDependencyTests-786286978 None] Acquiring lock "cinder-quobyte-0b52fff3-882e-49ff-883a-c1a820ddb562" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:05 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.info Apr 16 23:08:05 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d01e41b3-7092-406b-942b-ce2711aaf85f tempest-VolumeDependencyTests-786286978 None] Lock "cinder-quobyte-0b52fff3-882e-49ff-883a-c1a820ddb562" acquired by "delete_volume" :: waited 0.014s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[7deb2c92-d965-44a5-ad13-a3d25da76c17]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d01e41b3-7092-406b-942b-ce2711aaf85f tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:05 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562 Apr 16 23:08:05 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:05 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-95c36941-a003-4b2b-b8cb-533638acd80e tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ffa26562-b06d-4eab-9e6d-7db985ff97de" returned: 0 in 0.559s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:05 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-95c36941-a003-4b2b-b8cb-533638acd80e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-quobyte-ffa26562-b06d-4eab-9e6d-7db985ff97de" released by "delete_volume" :: held 1.478s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-95c36941-a003-4b2b-b8cb-533638acd80e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Created reservations ['678faf50-1f35-4023-b00f-03e39464f9a7', 'b69e2210-650e-4c4d-8ddf-87d8aee6a7cf', '4f191815-8443-4983-bd7a-580ab289c7b7', '11ad4050-bcfe-47bc-836b-740fde1f3852'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-95c36941-a003-4b2b-b8cb-533638acd80e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-95c36941-a003-4b2b-b8cb-533638acd80e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-95c36941-a003-4b2b-b8cb-533638acd80e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-95c36941-a003-4b2b-b8cb-533638acd80e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-95c36941-a003-4b2b-b8cb-533638acd80e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-95c36941-a003-4b2b-b8cb-533638acd80e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:06 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:08:06 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:06 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0620e776-ba3f-4134-aa36-1bc00a441c95 tempest-SnapshotDependencyTests-854076519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.info" returned: 0 in 0.422s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:06 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-0620e776-ba3f-4134-aa36-1bc00a441c95 tempest-SnapshotDependencyTests-854076519 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.info is being set with open permissions: ugo+rw Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0620e776-ba3f-4134-aa36-1bc00a441c95 tempest-SnapshotDependencyTests-854076519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:06 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.info Apr 16 23:08:06 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:06 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d01e41b3-7092-406b-942b-ce2711aaf85f tempest-VolumeDependencyTests-786286978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562" returned: 0 in 0.565s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d01e41b3-7092-406b-942b-ce2711aaf85f tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:06 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562 Apr 16 23:08:06 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4d8f665c-dace-48df-b33a-1af5f5ef42c0 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "cinder-83346606-41a6-4730-8368-3747a85c6fe7-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4d8f665c-dace-48df-b33a-1af5f5ef42c0 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-83346606-41a6-4730-8368-3747a85c6fe7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4d8f665c-dace-48df-b33a-1af5f5ef42c0 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "cinder-quobyte-e5ae43b5-e600-4068-b081-d2f9039bb1e4" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4d8f665c-dace-48df-b33a-1af5f5ef42c0 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-quobyte-e5ae43b5-e600-4068-b081-d2f9039bb1e4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4d8f665c-dace-48df-b33a-1af5f5ef42c0 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "cinder-quobyte-83346606-41a6-4730-8368-3747a85c6fe7" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4d8f665c-dace-48df-b33a-1af5f5ef42c0 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-quobyte-83346606-41a6-4730-8368-3747a85c6fe7" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:06 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-4d8f665c-dace-48df-b33a-1af5f5ef42c0 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Deleting offline snapshot 83346606-41a6-4730-8368-3747a85c6fe7 of volume e5ae43b5-e600-4068-b081-d2f9039bb1e4 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-4d8f665c-dace-48df-b33a-1af5f5ef42c0 tempest-CreateVolumesFromSnapshotTest-1245930787 None] snapshot_file for this snap is: volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.83346606-41a6-4730-8368-3747a85c6fe7 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-95c36941-a003-4b2b-b8cb-533638acd80e tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.593s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-95c36941-a003-4b2b-b8cb-533638acd80e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[885dc60b-1915-474c-ab5f-3f5f1252e251]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4d8f665c-dace-48df-b33a-1af5f5ef42c0 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.83346606-41a6-4730-8368-3747a85c6fe7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:06 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-95c36941-a003-4b2b-b8cb-533638acd80e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Deleted volume successfully. Apr 16 23:08:06 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-95c36941-a003-4b2b-b8cb-533638acd80e tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-ffa26562-b06d-4eab-9e6d-7db985ff97de-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-0620e776-ba3f-4134-aa36-1bc00a441c95 tempest-SnapshotDependencyTests-854076519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.info" returned: 0 in 0.582s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-0620e776-ba3f-4134-aa36-1bc00a441c95 tempest-SnapshotDependencyTests-854076519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.800s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.646s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-370326729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bb67679-3d15-4235-848c-f3e850ab12c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='384da5efe68f4fa6a937bb199aeae718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:08:04Z,use_quota=True,user_id='a5ec6a56d99740699e3557bd98b81b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Creating volume 9bb67679-3d15-4235-848c-f3e850ab12c9 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:08:06 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9bb67679-3d15-4235-848c-f3e850ab12c9 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:06 devstack sudo[90463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9bb67679-3d15-4235-848c-f3e850ab12c9 1073741824 Apr 16 23:08:06 devstack sudo[90463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:06 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-0620e776-ba3f-4134-aa36-1bc00a441c95 tempest-SnapshotDependencyTests-854076519 None] Create snapshot completed successfully Apr 16 23:08:06 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.83346606-41a6-4730-8368-3747a85c6fe7 Apr 16 23:08:06 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:06 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d01e41b3-7092-406b-942b-ce2711aaf85f tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0b52fff3-882e-49ff-883a-c1a820ddb562" returned: 0 in 0.493s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d01e41b3-7092-406b-942b-ce2711aaf85f tempest-VolumeDependencyTests-786286978 None] Lock "cinder-quobyte-0b52fff3-882e-49ff-883a-c1a820ddb562" released by "delete_volume" :: held 1.092s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-d01e41b3-7092-406b-942b-ce2711aaf85f tempest-VolumeDependencyTests-786286978 None] Created reservations ['7922c816-74f3-4814-8dbe-01e60fabfc58', '3125d59a-fd12-4382-ba7d-707ab9a5853c', '96fb970d-018e-4a2d-87ce-33854a4f0f9b', 'dce14d9e-22d9-45e1-8c0c-963e8453bc8a'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d01e41b3-7092-406b-942b-ce2711aaf85f tempest-VolumeDependencyTests-786286978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d01e41b3-7092-406b-942b-ce2711aaf85f tempest-VolumeDependencyTests-786286978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d01e41b3-7092-406b-942b-ce2711aaf85f tempest-VolumeDependencyTests-786286978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-d01e41b3-7092-406b-942b-ce2711aaf85f tempest-VolumeDependencyTests-786286978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-d01e41b3-7092-406b-942b-ce2711aaf85f tempest-VolumeDependencyTests-786286978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:06 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d01e41b3-7092-406b-942b-ce2711aaf85f tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:06 devstack sudo[90466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:08:06 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:07 devstack sudo[90463]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9bb67679-3d15-4235-848c-f3e850ab12c9 1073741824" returned: 0 in 0.487s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9bb67679-3d15-4235-848c-f3e850ab12c9 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:07 devstack sudo[90474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9bb67679-3d15-4235-848c-f3e850ab12c9 Apr 16 23:08:07 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:07 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4d8f665c-dace-48df-b33a-1af5f5ef42c0 tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.83346606-41a6-4730-8368-3747a85c6fe7" returned: 0 in 0.638s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-4d8f665c-dace-48df-b33a-1af5f5ef42c0 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:08:07 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbd2fc0-19f4-410d-ac96-d18622d55a5e]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4d8f665c-dace-48df-b33a-1af5f5ef42c0 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:07 devstack sudo[90477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4 Apr 16 23:08:07 devstack sudo[90477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:07 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-d01e41b3-7092-406b-942b-ce2711aaf85f tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.573s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:07 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-d01e41b3-7092-406b-942b-ce2711aaf85f tempest-VolumeDependencyTests-786286978 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:08:07 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-d01e41b3-7092-406b-942b-ce2711aaf85f tempest-VolumeDependencyTests-786286978 None] Deleted volume successfully. Apr 16 23:08:07 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-d01e41b3-7092-406b-942b-ce2711aaf85f tempest-VolumeDependencyTests-786286978 None] Lock "cinder-0b52fff3-882e-49ff-883a-c1a820ddb562-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:07 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9bb67679-3d15-4235-848c-f3e850ab12c9" returned: 0 in 0.677s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:08:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.544s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-736335865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce47187d-565f-4c34-82bd-5874e5d1ede3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='384da5efe68f4fa6a937bb199aeae718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:08:04Z,use_quota=True,user_id='a5ec6a56d99740699e3557bd98b81b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:08:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Creating volume ce47187d-565f-4c34-82bd-5874e5d1ede3 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:08:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:07 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:08:07 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:08:07 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce47187d-565f-4c34-82bd-5874e5d1ede3 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:07 devstack sudo[90483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce47187d-565f-4c34-82bd-5874e5d1ede3 1073741824 Apr 16 23:08:07 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:07 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a667641e-3565-492e-9f53-030e854148b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bb67679-3d15-4235-848c-f3e850ab12c9', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:07 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f40329-b2b3-4b0c-939a-76564238eeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:07 devstack sudo[90477]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4d8f665c-dace-48df-b33a-1af5f5ef42c0 tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4" returned: 0 in 0.685s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:08 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Volume volume-9bb67679-3d15-4235-848c-f3e850ab12c9 (9bb67679-3d15-4235-848c-f3e850ab12c9): created successfully Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f40329-b2b3-4b0c-939a-76564238eeda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Flow 'volume_create_manager' (c50e3d04-79e5-4e79-bf79-312498c583c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4d8f665c-dace-48df-b33a-1af5f5ef42c0 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.83346606-41a6-4730-8368-3747a85c6fe7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:08:08 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.83346606-41a6-4730-8368-3747a85c6fe7 Apr 16 23:08:08 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:08 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-a52fcc6e-0ebc-42a7-b5c6-1daf6bda9948 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Created volume successfully. Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Flow 'volume_create_manager' (203e207d-f987-4be9-9c5c-c72ba292ea42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f1ab1d-d044-40ba-aaff-dcdf1b3a251e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f1ab1d-d044-40ba-aaff-dcdf1b3a251e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090cb613-f21d-424a-bb92-74677ffe8007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf4df9c148bd4fa1ae0acf803397063f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ef450517-f0d2-444f-b4aa-a4585c117787,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:08:08Z,use_quota=True,user_id='eb507a4058d046ee806fb8cee1e951bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12e8d65-0adc-431d-9236-bd4f7d09d6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d12e8d65-0adc-431d-9236-bd4f7d09d6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f61859-1465-4f00-b869-f8e8caaa93b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f61859-1465-4f00-b869-f8e8caaa93b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '090cb613-f21d-424a-bb92-74677ffe8007', 'volume_name': 'volume-090cb613-f21d-424a-bb92-74677ffe8007', 'volume_size': 1, 'snapshot_id': 'ef450517-f0d2-444f-b4aa-a4585c117787'}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (776c0ce3-af40-47d0-92b6-235058085e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (776c0ce3-af40-47d0-92b6-235058085e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa171d25-dc50-437e-87b1-d61510e1d5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:08 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Volume 090cb613-f21d-424a-bb92-74677ffe8007: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-090cb613-f21d-424a-bb92-74677ffe8007', 'volume_size': 1, 'snapshot_id': 'ef450517-f0d2-444f-b4aa-a4585c117787'} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Flow 'volume_create_manager' (3748fc40-dba2-43e0-adcf-dfb927f7032d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d915ebad-f60b-4442-9f1b-072e20b0387d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d915ebad-f60b-4442-9f1b-072e20b0387d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-35260707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f55474-864c-4f43-9889-4d5c5bbaecdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947f0ee86328495ba7f027f073cfe0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:08:08Z,use_quota=True,user_id='2737acc8e6be4dd49775e6a8b094da56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa500f03-f628-4425-8925-03ee92a6145a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa500f03-f628-4425-8925-03ee92a6145a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b4de3dd-ae7e-4523-acf5-129968fa316d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b4de3dd-ae7e-4523-acf5-129968fa316d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77f55474-864c-4f43-9889-4d5c5bbaecdc', 'volume_name': 'volume-77f55474-864c-4f43-9889-4d5c5bbaecdc', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac109901-74b9-4dc0-92bb-a241d0162ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac109901-74b9-4dc0-92bb-a241d0162ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d01288-1854-4437-9fde-cab5c38f7def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:08 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Volume 77f55474-864c-4f43-9889-4d5c5bbaecdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77f55474-864c-4f43-9889-4d5c5bbaecdc', 'volume_size': 1} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:08 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce47187d-565f-4c34-82bd-5874e5d1ede3 1073741824" returned: 0 in 0.703s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce47187d-565f-4c34-82bd-5874e5d1ede3 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:08 devstack sudo[90493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce47187d-565f-4c34-82bd-5874e5d1ede3 Apr 16 23:08:08 devstack sudo[90493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:08 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4d8f665c-dace-48df-b33a-1af5f5ef42c0 tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.83346606-41a6-4730-8368-3747a85c6fe7" returned: 0 in 0.692s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:08 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4d8f665c-dace-48df-b33a-1af5f5ef42c0 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.83346606-41a6-4730-8368-3747a85c6fe7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:08 devstack sudo[90495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.83346606-41a6-4730-8368-3747a85c6fe7 Apr 16 23:08:08 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:09 devstack sudo[90493]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce47187d-565f-4c34-82bd-5874e5d1ede3" returned: 0 in 0.546s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] <== create_volume: return (1285ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.412s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1987781933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49445796-0c25-4a73-8f78-fcb22be8c324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='384da5efe68f4fa6a937bb199aeae718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:08:05Z,use_quota=True,user_id='a5ec6a56d99740699e3557bd98b81b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Creating volume 49445796-0c25-4a73-8f78-fcb22be8c324 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:08:09 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-49445796-0c25-4a73-8f78-fcb22be8c324 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71922265-a544-4dda-95a4-a18a1b35599b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce47187d-565f-4c34-82bd-5874e5d1ede3', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75609f56-0d84-42b8-aa38-529bd270f174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:09 devstack sudo[90499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-49445796-0c25-4a73-8f78-fcb22be8c324 1073741824 Apr 16 23:08:09 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:09 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Volume volume-ce47187d-565f-4c34-82bd-5874e5d1ede3 (ce47187d-565f-4c34-82bd-5874e5d1ede3): created successfully Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75609f56-0d84-42b8-aa38-529bd270f174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Flow 'volume_create_manager' (e138365a-7818-4bf9-887d-c5f2b3e1841b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:08:09 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-9b949443-4d98-4294-9f5b-778258998251 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Created volume successfully. Apr 16 23:08:09 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-4d8f665c-dace-48df-b33a-1af5f5ef42c0 tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4.83346606-41a6-4730-8368-3747a85c6fe7" returned: 0 in 0.609s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4d8f665c-dace-48df-b33a-1af5f5ef42c0 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-quobyte-83346606-41a6-4730-8368-3747a85c6fe7" released by "_delete_snapshot" :: held 2.700s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4d8f665c-dace-48df-b33a-1af5f5ef42c0 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-quobyte-e5ae43b5-e600-4068-b081-d2f9039bb1e4" released by "delete_snapshot" :: held 2.718s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-4d8f665c-dace-48df-b33a-1af5f5ef42c0 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Created reservations ['6c70b4ef-2842-4023-9c62-7c107d5754d8', 'e69f8b2e-c391-4ae5-aef5-6e3a4edc80ba', '6a10c6ea-aa4c-4491-8663-77d272377eac', '2b3f8b82-bd91-422b-9720-9bb2437813be'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:08:09 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-4d8f665c-dace-48df-b33a-1af5f5ef42c0 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Delete snapshot completed successfully. Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-4d8f665c-dace-48df-b33a-1af5f5ef42c0 tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-83346606-41a6-4730-8368-3747a85c6fe7-delete_snapshot" released by "delete_snapshot" :: held 2.836s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e63da8a8-b572-45bc-a15e-3adf45ffff8d tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "cinder-e5ae43b5-e600-4068-b081-d2f9039bb1e4-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e63da8a8-b572-45bc-a15e-3adf45ffff8d tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-e5ae43b5-e600-4068-b081-d2f9039bb1e4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e63da8a8-b572-45bc-a15e-3adf45ffff8d tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "cinder-quobyte-e5ae43b5-e600-4068-b081-d2f9039bb1e4" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e63da8a8-b572-45bc-a15e-3adf45ffff8d tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-quobyte-e5ae43b5-e600-4068-b081-d2f9039bb1e4" acquired by "delete_volume" :: waited 0.016s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef041c35-0ae8-4c6e-9560-7cf0a084d715]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e63da8a8-b572-45bc-a15e-3adf45ffff8d tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:09 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:09 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-49445796-0c25-4a73-8f78-fcb22be8c324 1073741824" returned: 0 in 0.745s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:09 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4 Apr 16 23:08:09 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-49445796-0c25-4a73-8f78-fcb22be8c324 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:10 devstack sudo[90506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-49445796-0c25-4a73-8f78-fcb22be8c324 Apr 16 23:08:10 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:10 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-49445796-0c25-4a73-8f78-fcb22be8c324" returned: 0 in 0.524s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] <== create_volume: return (1309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:08:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.312s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:10 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.347s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1374967332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d8b841b-745a-4903-8a53-848fd3a6b6fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='384da5efe68f4fa6a937bb199aeae718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:08:05Z,use_quota=True,user_id='a5ec6a56d99740699e3557bd98b81b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:08:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Creating volume 0d8b841b-745a-4903-8a53-848fd3a6b6fe {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:08:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:10 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:08:10 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:08:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0d8b841b-745a-4903-8a53-848fd3a6b6fe 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccac53b6-9716-4493-a813-2e22a93ac200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49445796-0c25-4a73-8f78-fcb22be8c324', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d187dc78-6a28-46e7-9789-394dcbe25fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:10 devstack sudo[90512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0d8b841b-745a-4903-8a53-848fd3a6b6fe 1073741824 Apr 16 23:08:10 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e63da8a8-b572-45bc-a15e-3adf45ffff8d tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4" returned: 0 in 0.682s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:10 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e63da8a8-b572-45bc-a15e-3adf45ffff8d tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:10 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Volume volume-49445796-0c25-4a73-8f78-fcb22be8c324 (49445796-0c25-4a73-8f78-fcb22be8c324): created successfully Apr 16 23:08:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d187dc78-6a28-46e7-9789-394dcbe25fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:10 devstack sudo[90514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4 Apr 16 23:08:10 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:10 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Flow 'volume_create_manager' (9eef183b-ddd3-44ea-92ac-8c7f8d1386de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:08:10 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-360652ef-eeac-424f-959f-551b9047b067 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Created volume successfully. Apr 16 23:08:11 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e63da8a8-b572-45bc-a15e-3adf45ffff8d tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-e5ae43b5-e600-4068-b081-d2f9039bb1e4" returned: 0 in 0.620s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e63da8a8-b572-45bc-a15e-3adf45ffff8d tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-quobyte-e5ae43b5-e600-4068-b081-d2f9039bb1e4" released by "delete_volume" :: held 1.355s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-e63da8a8-b572-45bc-a15e-3adf45ffff8d tempest-CreateVolumesFromSnapshotTest-1245930787 None] Created reservations ['246962da-2720-40d2-951c-ef010553e8da', '76a363f4-718d-4952-8f62-25aa72808b6f', '7c2ff334-dfb8-4ec4-b3e9-95ee24d086e9', 'a11a14f2-8733-4550-9fe2-9f13671cb4e0'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:08:11 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0d8b841b-745a-4903-8a53-848fd3a6b6fe 1073741824" returned: 0 in 0.731s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0d8b841b-745a-4903-8a53-848fd3a6b6fe {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:11 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0d8b841b-745a-4903-8a53-848fd3a6b6fe Apr 16 23:08:11 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e63da8a8-b572-45bc-a15e-3adf45ffff8d tempest-CreateVolumesFromSnapshotTest-1245930787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e63da8a8-b572-45bc-a15e-3adf45ffff8d tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e63da8a8-b572-45bc-a15e-3adf45ffff8d tempest-CreateVolumesFromSnapshotTest-1245930787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-e63da8a8-b572-45bc-a15e-3adf45ffff8d tempest-CreateVolumesFromSnapshotTest-1245930787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-e63da8a8-b572-45bc-a15e-3adf45ffff8d tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e63da8a8-b572-45bc-a15e-3adf45ffff8d tempest-CreateVolumesFromSnapshotTest-1245930787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:11 devstack sudo[90522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:08:11 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:11 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0d8b841b-745a-4903-8a53-848fd3a6b6fe" returned: 0 in 0.461s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.392s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1752630426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77fa1816-ceda-4d98-8ffc-478ebde1dc3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='384da5efe68f4fa6a937bb199aeae718',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:08:05Z,use_quota=True,user_id='a5ec6a56d99740699e3557bd98b81b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Creating volume 77fa1816-ceda-4d98-8ffc-478ebde1dc3e {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:08:11 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77fa1816-ceda-4d98-8ffc-478ebde1dc3e 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fe657af-e70a-49f8-aea3-9052ad4d365e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d8b841b-745a-4903-8a53-848fd3a6b6fe', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:11 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77fa1816-ceda-4d98-8ffc-478ebde1dc3e 1073741824 Apr 16 23:08:11 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799f6ca8-f524-4a08-b709-adb30180eca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:11 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Volume volume-0d8b841b-745a-4903-8a53-848fd3a6b6fe (0d8b841b-745a-4903-8a53-848fd3a6b6fe): created successfully Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799f6ca8-f524-4a08-b709-adb30180eca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Flow 'volume_create_manager' (0504a7e0-3866-4176-8ce2-3d3e015bf215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:08:11 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-5d3b81ed-98dd-4e81-a034-d04c044567c4 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Created volume successfully. Apr 16 23:08:11 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-e63da8a8-b572-45bc-a15e-3adf45ffff8d tempest-CreateVolumesFromSnapshotTest-1245930787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.519s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-e63da8a8-b572-45bc-a15e-3adf45ffff8d tempest-CreateVolumesFromSnapshotTest-1245930787 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:08:11 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-e63da8a8-b572-45bc-a15e-3adf45ffff8d tempest-CreateVolumesFromSnapshotTest-1245930787 None] Deleted volume successfully. Apr 16 23:08:11 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-e63da8a8-b572-45bc-a15e-3adf45ffff8d tempest-CreateVolumesFromSnapshotTest-1245930787 None] Lock "cinder-e5ae43b5-e600-4068-b081-d2f9039bb1e4-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:12 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77fa1816-ceda-4d98-8ffc-478ebde1dc3e 1073741824" returned: 0 in 0.571s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77fa1816-ceda-4d98-8ffc-478ebde1dc3e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:12 devstack sudo[90532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77fa1816-ceda-4d98-8ffc-478ebde1dc3e Apr 16 23:08:12 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:12 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77fa1816-ceda-4d98-8ffc-478ebde1dc3e" returned: 0 in 0.497s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:08:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.762s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:12 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Acquiring lock "cinder-quobyte-ef450517-f0d2-444f-b4aa-a4585c117787-090cb613-f21d-424a-bb92-74677ffe8007" by "_create_volume_from_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:12 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (716ad4fa-adbe-435b-bbe3-4b4a83b62bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77fa1816-ceda-4d98-8ffc-478ebde1dc3e', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:12 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65051092-c760-4476-b134-912c3bcf20b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:12 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Volume volume-77fa1816-ceda-4d98-8ffc-478ebde1dc3e (77fa1816-ceda-4d98-8ffc-478ebde1dc3e): created successfully Apr 16 23:08:12 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65051092-c760-4476-b134-912c3bcf20b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:12 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Flow 'volume_create_manager' (1d3cb55c-92f4-48de-a9f5-eb80b062a20b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:08:12 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Lock "cinder-quobyte-ef450517-f0d2-444f-b4aa-a4585c117787-090cb613-f21d-424a-bb92-74677ffe8007" acquired by "_create_volume_from_snapshot" :: waited 0.067s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Creating volume 090cb613-f21d-424a-bb92-74677ffe8007 from snapshot ef450517-f0d2-444f-b4aa-a4585c117787 {{(pid=81971) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 16 23:08:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:12 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:12 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:08:13 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Acquiring lock "cinder-quobyte-090cb613-f21d-424a-bb92-74677ffe8007" by "_copy_volume_from_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:13 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-3e4c63ad-b7a1-4c7a-bc37-74e11e3bc5e7 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Created volume successfully. Apr 16 23:08:13 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Lock "cinder-quobyte-090cb613-f21d-424a-bb92-74677ffe8007" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] snapshot: ef450517-f0d2-444f-b4aa-a4585c117787, volume: 090cb613-f21d-424a-bb92-74677ffe8007, {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 23:08:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:13 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95e4ece-2350-496a-a9eb-635f87ef16d1]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.ef450517-f0d2-444f-b4aa-a4585c117787 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:13 devstack sudo[90535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.ef450517-f0d2-444f-b4aa-a4585c117787 Apr 16 23:08:13 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:13 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.ef450517-f0d2-444f-b4aa-a4585c117787" returned: 0 in 0.570s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:08:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2 {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 23:08:13 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Creating direct copy from snapshot {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 23:08:13 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab3a0f1-350b-4822-ace9-5dd064d24189]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:13 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:13 devstack sudo[90540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2 Apr 16 23:08:13 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-636607a1-8d89-4b6a-bbe2-7e8729fd80ef tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "cinder-77fa1816-ceda-4d98-8ffc-478ebde1dc3e-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-636607a1-8d89-4b6a-bbe2-7e8729fd80ef tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "cinder-77fa1816-ceda-4d98-8ffc-478ebde1dc3e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-636607a1-8d89-4b6a-bbe2-7e8729fd80ef tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "cinder-quobyte-77fa1816-ceda-4d98-8ffc-478ebde1dc3e" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:14 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-636607a1-8d89-4b6a-bbe2-7e8729fd80ef tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "cinder-quobyte-77fa1816-ceda-4d98-8ffc-478ebde1dc3e" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:14 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d44563a-770e-422a-a537-b1d887cb43cb]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:14 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-636607a1-8d89-4b6a-bbe2-7e8729fd80ef tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77fa1816-ceda-4d98-8ffc-478ebde1dc3e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2" returned: 0 in 0.630s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:14 devstack cinder-volume[81971]: DEBUG cinder.utils [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Path /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-090cb613-f21d-424a-bb92-74677ffe8007 not found in is_blk_device check {{(pid=81971) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 23:08:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-090cb613-f21d-424a-bb92-74677ffe8007 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:14 devstack sudo[90546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-090cb613-f21d-424a-bb92-74677ffe8007 Apr 16 23:08:14 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:14 devstack sudo[90545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77fa1816-ceda-4d98-8ffc-478ebde1dc3e Apr 16 23:08:14 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:14 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:08:14 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Flow 'volume_create_manager' (dd942f08-a75c-4494-b4ec-75abde264953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:08:14 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f66c163e-e25c-48bb-942f-0f822818234a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:14 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f66c163e-e25c-48bb-942f-0f822818234a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c5cee7-f3b2-47dd-8be0-a9e31cd505d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf9b20d3c0504449b9f606864d921a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:08:15Z,use_quota=True,user_id='90af439d8a61425c99ad0573f8e2502b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:14 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccda9fdd-98d7-4e04-a54e-83e0f11033ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:14 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccda9fdd-98d7-4e04-a54e-83e0f11033ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:14 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec988ed9-fd41-433e-82ee-6251e8272479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:14 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec988ed9-fd41-433e-82ee-6251e8272479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40c5cee7-f3b2-47dd-8be0-a9e31cd505d2', 'volume_name': 'volume-40c5cee7-f3b2-47dd-8be0-a9e31cd505d2', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:14 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4926458a-22a8-4a0f-9386-1bb1c23bd6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:14 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4926458a-22a8-4a0f-9386-1bb1c23bd6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:14 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a397e7-242d-438e-9a6e-74af13ac159e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:14 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Volume 40c5cee7-f3b2-47dd-8be0-a9e31cd505d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40c5cee7-f3b2-47dd-8be0-a9e31cd505d2', 'volume_size': 1} Apr 16 23:08:14 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:15 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-636607a1-8d89-4b6a-bbe2-7e8729fd80ef tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77fa1816-ceda-4d98-8ffc-478ebde1dc3e" returned: 0 in 1.142s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:15 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-636607a1-8d89-4b6a-bbe2-7e8729fd80ef tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77fa1816-ceda-4d98-8ffc-478ebde1dc3e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:15 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77fa1816-ceda-4d98-8ffc-478ebde1dc3e Apr 16 23:08:15 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:17 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-090cb613-f21d-424a-bb92-74677ffe8007" returned: 0 in 2.808s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:17 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8969993-7e61-4079-894d-8a4fff9bcb87]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:17 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-636607a1-8d89-4b6a-bbe2-7e8729fd80ef tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77fa1816-ceda-4d98-8ffc-478ebde1dc3e" returned: 0 in 1.759s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:17 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-636607a1-8d89-4b6a-bbe2-7e8729fd80ef tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "cinder-quobyte-77fa1816-ceda-4d98-8ffc-478ebde1dc3e" released by "delete_volume" :: held 2.935s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:17 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2 Apr 16 23:08:17 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:17 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-636607a1-8d89-4b6a-bbe2-7e8729fd80ef tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Created reservations ['25a6a6d7-4627-4798-99fa-28a37ceb3a9c', 'f1fe360e-fe77-4f7b-9676-db6ff2498ff8', 'da1c067a-13c7-45ce-8cf9-8c47d9aea576', '3a640c76-6a66-4bf0-a202-20e0716b9a14'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:08:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-636607a1-8d89-4b6a-bbe2-7e8729fd80ef tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-636607a1-8d89-4b6a-bbe2-7e8729fd80ef tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:17 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-636607a1-8d89-4b6a-bbe2-7e8729fd80ef tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:17 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-636607a1-8d89-4b6a-bbe2-7e8729fd80ef tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-636607a1-8d89-4b6a-bbe2-7e8729fd80ef tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-636607a1-8d89-4b6a-bbe2-7e8729fd80ef tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:17 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:08:17 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:17 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-075f5709-f171-4cb9-a92e-c52b4aee4dd3 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "cinder-0d8b841b-745a-4903-8a53-848fd3a6b6fe-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:17 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-075f5709-f171-4cb9-a92e-c52b4aee4dd3 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "cinder-0d8b841b-745a-4903-8a53-848fd3a6b6fe-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:17 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-075f5709-f171-4cb9-a92e-c52b4aee4dd3 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "cinder-quobyte-0d8b841b-745a-4903-8a53-848fd3a6b6fe" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:17 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-075f5709-f171-4cb9-a92e-c52b4aee4dd3 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "cinder-quobyte-0d8b841b-745a-4903-8a53-848fd3a6b6fe" acquired by "delete_volume" :: waited 0.009s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:17 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1721dcf-c9fc-4191-ba10-f5e56af21818]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-075f5709-f171-4cb9-a92e-c52b4aee4dd3 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0d8b841b-745a-4903-8a53-848fd3a6b6fe {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:17 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-636607a1-8d89-4b6a-bbe2-7e8729fd80ef tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.543s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:17 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-636607a1-8d89-4b6a-bbe2-7e8729fd80ef tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:08:17 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-636607a1-8d89-4b6a-bbe2-7e8729fd80ef tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Deleted volume successfully. Apr 16 23:08:17 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-636607a1-8d89-4b6a-bbe2-7e8729fd80ef tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "cinder-77fa1816-ceda-4d98-8ffc-478ebde1dc3e-delete_volume" released by "delete_volume" :: held 3.664s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:17 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0d8b841b-745a-4903-8a53-848fd3a6b6fe Apr 16 23:08:17 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:17 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2" returned: 0 in 0.870s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:17 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Image conversion details: src /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2, size 1024.00 MB, duration 2.81 sec, destination /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-090cb613-f21d-424a-bb92-74677ffe8007 {{(pid=81971) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 23:08:17 devstack cinder-volume[81971]: INFO cinder.image.image_utils [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Converted 1024.00 MB image at 364.43 MB/s Apr 16 23:08:17 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-090cb613-f21d-424a-bb92-74677ffe8007 is being set with open permissions: ugo+rw Apr 16 23:08:17 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-090cb613-f21d-424a-bb92-74677ffe8007 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:18 devstack sudo[90576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-090cb613-f21d-424a-bb92-74677ffe8007 Apr 16 23:08:18 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:18 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-075f5709-f171-4cb9-a92e-c52b4aee4dd3 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0d8b841b-745a-4903-8a53-848fd3a6b6fe" returned: 0 in 0.605s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-075f5709-f171-4cb9-a92e-c52b4aee4dd3 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0d8b841b-745a-4903-8a53-848fd3a6b6fe {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:18 devstack sudo[90581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0d8b841b-745a-4903-8a53-848fd3a6b6fe Apr 16 23:08:18 devstack sudo[90581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:18 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-090cb613-f21d-424a-bb92-74677ffe8007" returned: 0 in 0.580s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Lock "cinder-quobyte-090cb613-f21d-424a-bb92-74677ffe8007" released by "_copy_volume_from_snapshot" :: held 5.540s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Lock "cinder-quobyte-ef450517-f0d2-444f-b4aa-a4585c117787-090cb613-f21d-424a-bb92-74677ffe8007" released by "_create_volume_from_snapshot" :: held 5.573s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.642s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.337s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:08:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-35260707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f55474-864c-4f43-9889-4d5c5bbaecdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947f0ee86328495ba7f027f073cfe0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:08:08Z,use_quota=True,user_id='2737acc8e6be4dd49775e6a8b094da56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Creating volume 77f55474-864c-4f43-9889-4d5c5bbaecdc {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:08:18 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa171d25-dc50-437e-87b1-d61510e1d5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-090cb613-f21d-424a-bb92-74677ffe8007', 'volume_size': 1, 'snapshot_id': 'ef450517-f0d2-444f-b4aa-a4585c117787'}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:18 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc 1073741824 Apr 16 23:08:18 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f00026-d2ef-4de4-b754-fe4b04b1a72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:18 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Volume volume-090cb613-f21d-424a-bb92-74677ffe8007 (090cb613-f21d-424a-bb92-74677ffe8007): created successfully Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f00026-d2ef-4de4-b754-fe4b04b1a72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Flow 'volume_create_manager' (203e207d-f987-4be9-9c5c-c72ba292ea42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:08:18 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-31c97d3a-5aa4-453b-81fa-60091b22a83a tempest-SnapshotDependencyTests-854076519 None] Created volume successfully. Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-771f9e8d-a876-4b14-8bd6-343e61f36f75 tempest-SnapshotDependencyTests-854076519 None] Acquiring lock "cinder-ef450517-f0d2-444f-b4aa-a4585c117787-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-771f9e8d-a876-4b14-8bd6-343e61f36f75 tempest-SnapshotDependencyTests-854076519 None] Lock "cinder-ef450517-f0d2-444f-b4aa-a4585c117787-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-771f9e8d-a876-4b14-8bd6-343e61f36f75 tempest-SnapshotDependencyTests-854076519 None] Acquiring lock "cinder-quobyte-ce9e3c32-eb35-44a1-8034-263839e3b0d2" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-771f9e8d-a876-4b14-8bd6-343e61f36f75 tempest-SnapshotDependencyTests-854076519 None] Lock "cinder-quobyte-ce9e3c32-eb35-44a1-8034-263839e3b0d2" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-771f9e8d-a876-4b14-8bd6-343e61f36f75 tempest-SnapshotDependencyTests-854076519 None] Acquiring lock "cinder-quobyte-ef450517-f0d2-444f-b4aa-a4585c117787" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-771f9e8d-a876-4b14-8bd6-343e61f36f75 tempest-SnapshotDependencyTests-854076519 None] Lock "cinder-quobyte-ef450517-f0d2-444f-b4aa-a4585c117787" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-771f9e8d-a876-4b14-8bd6-343e61f36f75 tempest-SnapshotDependencyTests-854076519 None] Deleting offline snapshot ef450517-f0d2-444f-b4aa-a4585c117787 of volume ce9e3c32-eb35-44a1-8034-263839e3b0d2 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-771f9e8d-a876-4b14-8bd6-343e61f36f75 tempest-SnapshotDependencyTests-854076519 None] snapshot_file for this snap is: volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.ef450517-f0d2-444f-b4aa-a4585c117787 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f38f90-d828-492e-962c-a0486983b6d4]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:18 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-771f9e8d-a876-4b14-8bd6-343e61f36f75 tempest-SnapshotDependencyTests-854076519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.ef450517-f0d2-444f-b4aa-a4585c117787 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:19 devstack sudo[90587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.ef450517-f0d2-444f-b4aa-a4585c117787 Apr 16 23:08:19 devstack sudo[90587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:19 devstack sudo[90581]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-075f5709-f171-4cb9-a92e-c52b4aee4dd3 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-0d8b841b-745a-4903-8a53-848fd3a6b6fe" returned: 0 in 0.657s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-075f5709-f171-4cb9-a92e-c52b4aee4dd3 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "cinder-quobyte-0d8b841b-745a-4903-8a53-848fd3a6b6fe" released by "delete_volume" :: held 1.292s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-075f5709-f171-4cb9-a92e-c52b4aee4dd3 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Created reservations ['5acdb457-0c7a-4078-8291-3174ce6391f6', '36d4fe95-2c64-4916-9835-4937c2cf7b86', '2f3f54f7-a98d-493c-9a5e-383a56cfeac2', 'b9b36b73-3f6f-4065-bf00-f81a43d83bcf'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-075f5709-f171-4cb9-a92e-c52b4aee4dd3 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-075f5709-f171-4cb9-a92e-c52b4aee4dd3 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-075f5709-f171-4cb9-a92e-c52b4aee4dd3 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-075f5709-f171-4cb9-a92e-c52b4aee4dd3 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-075f5709-f171-4cb9-a92e-c52b4aee4dd3 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-075f5709-f171-4cb9-a92e-c52b4aee4dd3 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:19 devstack sudo[90592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:08:19 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:19 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc 1073741824" returned: 0 in 0.785s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:19 devstack sudo[90594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc Apr 16 23:08:19 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:19 devstack sudo[90587]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-771f9e8d-a876-4b14-8bd6-343e61f36f75 tempest-SnapshotDependencyTests-854076519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.ef450517-f0d2-444f-b4aa-a4585c117787" returned: 0 in 0.729s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-771f9e8d-a876-4b14-8bd6-343e61f36f75 tempest-SnapshotDependencyTests-854076519 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27b8bec-6c50-48f9-9b74-9f8e8713a82d]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-771f9e8d-a876-4b14-8bd6-343e61f36f75 tempest-SnapshotDependencyTests-854076519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:19 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-075f5709-f171-4cb9-a92e-c52b4aee4dd3 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.511s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-075f5709-f171-4cb9-a92e-c52b4aee4dd3 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:08:19 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-075f5709-f171-4cb9-a92e-c52b4aee4dd3 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Deleted volume successfully. Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-075f5709-f171-4cb9-a92e-c52b4aee4dd3 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "cinder-0d8b841b-745a-4903-8a53-848fd3a6b6fe-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:19 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2 Apr 16 23:08:19 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:19 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc" returned: 0 in 0.504s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] <== create_volume: return (1324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.226s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40c5cee7-f3b2-47dd-8be0-a9e31cd505d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf9b20d3c0504449b9f606864d921a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:08:15Z,use_quota=True,user_id='90af439d8a61425c99ad0573f8e2502b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Creating volume 40c5cee7-f3b2-47dd-8be0-a9e31cd505d2 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:08:19 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-40c5cee7-f3b2-47dd-8be0-a9e31cd505d2 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d01288-1854-4437-9fde-cab5c38f7def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77f55474-864c-4f43-9889-4d5c5bbaecdc', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb4655b-7f32-40c6-b366-812119095ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:19 devstack sudo[90603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-40c5cee7-f3b2-47dd-8be0-a9e31cd505d2 1073741824 Apr 16 23:08:19 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:19 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-dde978df-6567-4c4e-bcc5-073c5333860a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "cinder-49445796-0c25-4a73-8f78-fcb22be8c324-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:19 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Volume volume-77f55474-864c-4f43-9889-4d5c5bbaecdc (77f55474-864c-4f43-9889-4d5c5bbaecdc): created successfully Apr 16 23:08:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb4655b-7f32-40c6-b366-812119095ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Flow 'volume_create_manager' (3748fc40-dba2-43e0-adcf-dfb927f7032d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:08:20 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-dde978df-6567-4c4e-bcc5-073c5333860a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "cinder-49445796-0c25-4a73-8f78-fcb22be8c324-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:20 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-9028b4bc-3a0d-4a76-a10e-19e1fd8339b2 tempest-VolumeDependencyTests-786286978 None] Created volume successfully. Apr 16 23:08:20 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-dde978df-6567-4c4e-bcc5-073c5333860a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "cinder-quobyte-49445796-0c25-4a73-8f78-fcb22be8c324" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:20 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-dde978df-6567-4c4e-bcc5-073c5333860a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "cinder-quobyte-49445796-0c25-4a73-8f78-fcb22be8c324" acquired by "delete_volume" :: waited 0.009s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:20 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[62763c5a-ab9b-4606-afdf-cb5f33452427]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dde978df-6567-4c4e-bcc5-073c5333860a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-49445796-0c25-4a73-8f78-fcb22be8c324 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:20 devstack sudo[90605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-49445796-0c25-4a73-8f78-fcb22be8c324 Apr 16 23:08:20 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:20 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-771f9e8d-a876-4b14-8bd6-343e61f36f75 tempest-SnapshotDependencyTests-854076519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2" returned: 0 in 0.712s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-771f9e8d-a876-4b14-8bd6-343e61f36f75 tempest-SnapshotDependencyTests-854076519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.ef450517-f0d2-444f-b4aa-a4585c117787 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:20 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.ef450517-f0d2-444f-b4aa-a4585c117787 Apr 16 23:08:20 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:20 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:08:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Flow 'volume_create_manager' (6dcda20f-240e-4249-a29f-5c5b989ef6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:08:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2cf5951-4166-4987-92b3-3a15a707f92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:20 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2cf5951-4166-4987-92b3-3a15a707f92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1635092936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddab6cf5-3111-49af-8b7d-d2a4e6928bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='947f0ee86328495ba7f027f073cfe0fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=77f55474-864c-4f43-9889-4d5c5bbaecdc,status='creating',terminated_at=None,updated_at=2026-04-16T21:08:21Z,use_quota=True,user_id='2737acc8e6be4dd49775e6a8b094da56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a0cab79-a4cb-4eb0-8c93-9a5f6c71d21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a0cab79-a4cb-4eb0-8c93-9a5f6c71d21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483ad05b-3e89-4ab5-8365-d66d7af8df3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:20 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-40c5cee7-f3b2-47dd-8be0-a9e31cd505d2 1073741824" returned: 0 in 0.839s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dde978df-6567-4c4e-bcc5-073c5333860a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-49445796-0c25-4a73-8f78-fcb22be8c324" returned: 0 in 0.700s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (483ad05b-3e89-4ab5-8365-d66d7af8df3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ddab6cf5-3111-49af-8b7d-d2a4e6928bee', 'volume_name': 'volume-ddab6cf5-3111-49af-8b7d-d2a4e6928bee', 'volume_size': 1, 'source_volid': '77f55474-864c-4f43-9889-4d5c5bbaecdc', 'source_volstatus': 'available'}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4574124d-8113-4e2d-9fae-bb7750754591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4574124d-8113-4e2d-9fae-bb7750754591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:20 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91460cc-6e03-43eb-b140-3d90163e4e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:20 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Volume ddab6cf5-3111-49af-8b7d-d2a4e6928bee: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ddab6cf5-3111-49af-8b7d-d2a4e6928bee', 'volume_size': 1, 'source_volid': '77f55474-864c-4f43-9889-4d5c5bbaecdc', 'source_volstatus': 'available'} Apr 16 23:08:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dde978df-6567-4c4e-bcc5-073c5333860a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-49445796-0c25-4a73-8f78-fcb22be8c324 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:20 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-40c5cee7-f3b2-47dd-8be0-a9e31cd505d2 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:20 devstack sudo[90618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-49445796-0c25-4a73-8f78-fcb22be8c324 Apr 16 23:08:20 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:20 devstack sudo[90621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-40c5cee7-f3b2-47dd-8be0-a9e31cd505d2 Apr 16 23:08:20 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:21 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-771f9e8d-a876-4b14-8bd6-343e61f36f75 tempest-SnapshotDependencyTests-854076519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.ef450517-f0d2-444f-b4aa-a4585c117787" returned: 0 in 0.666s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-771f9e8d-a876-4b14-8bd6-343e61f36f75 tempest-SnapshotDependencyTests-854076519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.ef450517-f0d2-444f-b4aa-a4585c117787 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:21 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.ef450517-f0d2-444f-b4aa-a4585c117787 Apr 16 23:08:21 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:21 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dde978df-6567-4c4e-bcc5-073c5333860a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-49445796-0c25-4a73-8f78-fcb22be8c324" returned: 0 in 0.553s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-dde978df-6567-4c4e-bcc5-073c5333860a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "cinder-quobyte-49445796-0c25-4a73-8f78-fcb22be8c324" released by "delete_volume" :: held 1.308s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:21 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-40c5cee7-f3b2-47dd-8be0-a9e31cd505d2" returned: 0 in 0.572s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.590s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:21 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Cloning volume 77f55474-864c-4f43-9889-4d5c5bbaecdc to volume ddab6cf5-3111-49af-8b7d-d2a4e6928bee Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34a397e7-242d-438e-9a6e-74af13ac159e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40c5cee7-f3b2-47dd-8be0-a9e31cd505d2', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b08a85-5c03-4953-bd2c-155737b423f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:21 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Volume volume-40c5cee7-f3b2-47dd-8be0-a9e31cd505d2 (40c5cee7-f3b2-47dd-8be0-a9e31cd505d2): created successfully Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53b08a85-5c03-4953-bd2c-155737b423f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Flow 'volume_create_manager' (dd942f08-a75c-4494-b4ec-75abde264953) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-dde978df-6567-4c4e-bcc5-073c5333860a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Created reservations ['6a0de5de-b230-4ea2-a5b2-c0bc6c3e1e9f', '41e19d82-2e0f-4adb-8a7d-d133497d8c8f', '25cd05e1-48e1-4219-a9d2-a0f8710aea97', '09600708-9246-497c-9d7b-eae62a4fabdc'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Creating offline snapshot 2be3ab90-7729-42fc-b24a-c2a69665078a of volume 77f55474-864c-4f43-9889-4d5c5bbaecdc {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:08:21 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-65ac5ea6-1816-4c0a-9d69-a9f33f3433bc tempest-CinderUnicodeTest-325283011 None] Created volume successfully. Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a326043-c703-40b7-ab11-9734e709c1a9]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-dde978df-6567-4c4e-bcc5-073c5333860a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-dde978df-6567-4c4e-bcc5-073c5333860a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-dde978df-6567-4c4e-bcc5-073c5333860a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-dde978df-6567-4c4e-bcc5-073c5333860a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:21 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-dde978df-6567-4c4e-bcc5-073c5333860a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dde978df-6567-4c4e-bcc5-073c5333860a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-771f9e8d-a876-4b14-8bd6-343e61f36f75 tempest-SnapshotDependencyTests-854076519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2.ef450517-f0d2-444f-b4aa-a4585c117787" returned: 0 in 0.504s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:21 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc Apr 16 23:08:21 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:21 devstack sudo[90631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:08:21 devstack sudo[90631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-771f9e8d-a876-4b14-8bd6-343e61f36f75 tempest-SnapshotDependencyTests-854076519 None] Lock "cinder-quobyte-ef450517-f0d2-444f-b4aa-a4585c117787" released by "_delete_snapshot" :: held 2.697s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-771f9e8d-a876-4b14-8bd6-343e61f36f75 tempest-SnapshotDependencyTests-854076519 None] Lock "cinder-quobyte-ce9e3c32-eb35-44a1-8034-263839e3b0d2" released by "delete_snapshot" :: held 2.714s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-771f9e8d-a876-4b14-8bd6-343e61f36f75 tempest-SnapshotDependencyTests-854076519 None] Created reservations ['f9531ec0-4644-4ced-b36a-86a049630b3c', 'c45b9aa0-a8be-4617-8114-f2aa8bfd1037', 'afcff863-f679-4edb-ba26-155ead666d7a', '9dcb797e-3cce-43a7-866e-cedeb8306948'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:08:21 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-771f9e8d-a876-4b14-8bd6-343e61f36f75 tempest-SnapshotDependencyTests-854076519 None] Delete snapshot completed successfully. Apr 16 23:08:21 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-771f9e8d-a876-4b14-8bd6-343e61f36f75 tempest-SnapshotDependencyTests-854076519 None] Lock "cinder-ef450517-f0d2-444f-b4aa-a4585c117787-delete_snapshot" released by "delete_snapshot" :: held 2.844s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a0a9a3a9-c493-4fde-95a7-e2ab8d01c302 tempest-SnapshotDependencyTests-854076519 None] Acquiring lock "cinder-ce9e3c32-eb35-44a1-8034-263839e3b0d2-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a0a9a3a9-c493-4fde-95a7-e2ab8d01c302 tempest-SnapshotDependencyTests-854076519 None] Lock "cinder-ce9e3c32-eb35-44a1-8034-263839e3b0d2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a0a9a3a9-c493-4fde-95a7-e2ab8d01c302 tempest-SnapshotDependencyTests-854076519 None] Acquiring lock "cinder-quobyte-ce9e3c32-eb35-44a1-8034-263839e3b0d2" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a0a9a3a9-c493-4fde-95a7-e2ab8d01c302 tempest-SnapshotDependencyTests-854076519 None] Lock "cinder-quobyte-ce9e3c32-eb35-44a1-8034-263839e3b0d2" acquired by "delete_volume" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:22 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc" returned: 0 in 0.666s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.2be3ab90-7729-42fc-b24a-c2a69665078a 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[18084db5-ec8e-4cb8-bd46-76c810540a08]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:22 devstack sudo[90631]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a0a9a3a9-c493-4fde-95a7-e2ab8d01c302 tempest-SnapshotDependencyTests-854076519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:22 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.2be3ab90-7729-42fc-b24a-c2a69665078a 1G Apr 16 23:08:22 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-dde978df-6567-4c4e-bcc5-073c5333860a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.631s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-dde978df-6567-4c4e-bcc5-073c5333860a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:08:22 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-dde978df-6567-4c4e-bcc5-073c5333860a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Deleted volume successfully. Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-dde978df-6567-4c4e-bcc5-073c5333860a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "cinder-49445796-0c25-4a73-8f78-fcb22be8c324-delete_volume" released by "delete_volume" :: held 2.183s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f7dbb818-9e3c-495b-b276-44195d84c3f8 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "cinder-ce47187d-565f-4c34-82bd-5874e5d1ede3-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f7dbb818-9e3c-495b-b276-44195d84c3f8 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "cinder-ce47187d-565f-4c34-82bd-5874e5d1ede3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f7dbb818-9e3c-495b-b276-44195d84c3f8 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "cinder-quobyte-ce47187d-565f-4c34-82bd-5874e5d1ede3" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:22 devstack sudo[90640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2 Apr 16 23:08:22 devstack sudo[90640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f7dbb818-9e3c-495b-b276-44195d84c3f8 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "cinder-quobyte-ce47187d-565f-4c34-82bd-5874e5d1ede3" acquired by "delete_volume" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f3ceb3-bac6-4ece-a636-7770e1732a3d]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f7dbb818-9e3c-495b-b276-44195d84c3f8 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce47187d-565f-4c34-82bd-5874e5d1ede3 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:22 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce47187d-565f-4c34-82bd-5874e5d1ede3 Apr 16 23:08:22 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:22 devstack sudo[90640]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a0a9a3a9-c493-4fde-95a7-e2ab8d01c302 tempest-SnapshotDependencyTests-854076519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2" returned: 0 in 0.625s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a0a9a3a9-c493-4fde-95a7-e2ab8d01c302 tempest-SnapshotDependencyTests-854076519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:22 devstack sudo[90652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2 Apr 16 23:08:22 devstack sudo[90652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81971) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Flow 'volume_create_manager' (fb448dab-055a-4df1-bc12-ff99eff72841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4775c04-0b51-49fa-9656-91d770a3687d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4775c04-0b51-49fa-9656-91d770a3687d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:08:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1246291003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=675c0591-9714-474d-9e1b-8d6460ade4e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf9b20d3c0504449b9f606864d921a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:08:23Z,use_quota=True,user_id='90af439d8a61425c99ad0573f8e2502b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a9d88e-a086-400a-b8b3-11b7fbfab726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74a9d88e-a086-400a-b8b3-11b7fbfab726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22292ad8-9261-4f26-b514-5453cbd383ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:22 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22292ad8-9261-4f26-b514-5453cbd383ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '675c0591-9714-474d-9e1b-8d6460ade4e7', 'volume_name': 'volume-675c0591-9714-474d-9e1b-8d6460ade4e7', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21386a27-b619-49a9-8a4d-8dae2191358e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21386a27-b619-49a9-8a4d-8dae2191358e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41eb8c23-81c4-4916-9f0f-e53c4f9b78f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:22 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Volume 675c0591-9714-474d-9e1b-8d6460ade4e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-675c0591-9714-474d-9e1b-8d6460ade4e7', 'volume_size': 1} Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.2be3ab90-7729-42fc-b24a-c2a69665078a 1G" returned: 0 in 0.786s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:22 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77f55474-864c-4f43-9889-4d5c5bbaecdc -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.2be3ab90-7729-42fc-b24a-c2a69665078a {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:22 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77f55474-864c-4f43-9889-4d5c5bbaecdc -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.2be3ab90-7729-42fc-b24a-c2a69665078a Apr 16 23:08:22 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:23 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f7dbb818-9e3c-495b-b276-44195d84c3f8 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce47187d-565f-4c34-82bd-5874e5d1ede3" returned: 0 in 0.726s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f7dbb818-9e3c-495b-b276-44195d84c3f8 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce47187d-565f-4c34-82bd-5874e5d1ede3 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:23 devstack sudo[90659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce47187d-565f-4c34-82bd-5874e5d1ede3 Apr 16 23:08:23 devstack sudo[90659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:23 devstack sudo[90652]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a0a9a3a9-c493-4fde-95a7-e2ab8d01c302 tempest-SnapshotDependencyTests-854076519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce9e3c32-eb35-44a1-8034-263839e3b0d2" returned: 0 in 0.608s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:23 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a0a9a3a9-c493-4fde-95a7-e2ab8d01c302 tempest-SnapshotDependencyTests-854076519 None] Lock "cinder-quobyte-ce9e3c32-eb35-44a1-8034-263839e3b0d2" released by "delete_volume" :: held 1.285s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:23 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-a0a9a3a9-c493-4fde-95a7-e2ab8d01c302 tempest-SnapshotDependencyTests-854076519 None] Created reservations ['8c383a0b-df40-4f40-96ba-ef38b7fb8beb', '6b4b73be-d421-45c7-9eaa-3b45b0839d32', 'ab69069f-4038-4286-86a5-b721cce9233c', '1b64547b-6fa5-43e0-9172-8d51e072eb43'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:08:23 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-77f55474-864c-4f43-9889-4d5c5bbaecdc -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.2be3ab90-7729-42fc-b24a-c2a69665078a" returned: 0 in 0.542s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:23 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.2be3ab90-7729-42fc-b24a-c2a69665078a is being set with open permissions: ugo+rw Apr 16 23:08:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.2be3ab90-7729-42fc-b24a-c2a69665078a {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:23 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.2be3ab90-7729-42fc-b24a-c2a69665078a Apr 16 23:08:23 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a0a9a3a9-c493-4fde-95a7-e2ab8d01c302 tempest-SnapshotDependencyTests-854076519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a0a9a3a9-c493-4fde-95a7-e2ab8d01c302 tempest-SnapshotDependencyTests-854076519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a0a9a3a9-c493-4fde-95a7-e2ab8d01c302 tempest-SnapshotDependencyTests-854076519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a0a9a3a9-c493-4fde-95a7-e2ab8d01c302 tempest-SnapshotDependencyTests-854076519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a0a9a3a9-c493-4fde-95a7-e2ab8d01c302 tempest-SnapshotDependencyTests-854076519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a0a9a3a9-c493-4fde-95a7-e2ab8d01c302 tempest-SnapshotDependencyTests-854076519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:23 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:08:23 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:23 devstack sudo[90659]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f7dbb818-9e3c-495b-b276-44195d84c3f8 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ce47187d-565f-4c34-82bd-5874e5d1ede3" returned: 0 in 0.579s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:23 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f7dbb818-9e3c-495b-b276-44195d84c3f8 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "cinder-quobyte-ce47187d-565f-4c34-82bd-5874e5d1ede3" released by "delete_volume" :: held 1.350s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:23 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-f7dbb818-9e3c-495b-b276-44195d84c3f8 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Created reservations ['7d297221-c054-45db-8a9e-5aa333efb26d', 'ea8fbdf3-a1bc-447f-80b9-6da353aa5bdc', 'b6cc8167-4462-40fc-8dd9-fde883a86d6a', '267a278d-0fe9-4493-80cc-742aa4ce0123'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:08:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f7dbb818-9e3c-495b-b276-44195d84c3f8 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f7dbb818-9e3c-495b-b276-44195d84c3f8 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-f7dbb818-9e3c-495b-b276-44195d84c3f8 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:23 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-f7dbb818-9e3c-495b-b276-44195d84c3f8 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-f7dbb818-9e3c-495b-b276-44195d84c3f8 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f7dbb818-9e3c-495b-b276-44195d84c3f8 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:23 devstack sudo[90670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:08:23 devstack sudo[90670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:23 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.2be3ab90-7729-42fc-b24a-c2a69665078a" returned: 0 in 0.471s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:23 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:24 devstack sudo[90674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.info Apr 16 23:08:24 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:24 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a0a9a3a9-c493-4fde-95a7-e2ab8d01c302 tempest-SnapshotDependencyTests-854076519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.540s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:24 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-a0a9a3a9-c493-4fde-95a7-e2ab8d01c302 tempest-SnapshotDependencyTests-854076519 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:08:24 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-a0a9a3a9-c493-4fde-95a7-e2ab8d01c302 tempest-SnapshotDependencyTests-854076519 None] Deleted volume successfully. Apr 16 23:08:24 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a0a9a3a9-c493-4fde-95a7-e2ab8d01c302 tempest-SnapshotDependencyTests-854076519 None] Lock "cinder-ce9e3c32-eb35-44a1-8034-263839e3b0d2-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:24 devstack sudo[90670]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-f7dbb818-9e3c-495b-b276-44195d84c3f8 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.474s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:24 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-f7dbb818-9e3c-495b-b276-44195d84c3f8 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:08:24 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-f7dbb818-9e3c-495b-b276-44195d84c3f8 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Deleted volume successfully. Apr 16 23:08:24 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-f7dbb818-9e3c-495b-b276-44195d84c3f8 tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "cinder-ce47187d-565f-4c34-82bd-5874e5d1ede3-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:24 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-752d6157-522d-4ee4-a636-f9e2446b230e tempest-SnapshotDependencyTests-854076519 None] Acquiring lock "cinder-090cb613-f21d-424a-bb92-74677ffe8007-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:24 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-752d6157-522d-4ee4-a636-f9e2446b230e tempest-SnapshotDependencyTests-854076519 None] Lock "cinder-090cb613-f21d-424a-bb92-74677ffe8007-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:24 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-752d6157-522d-4ee4-a636-f9e2446b230e tempest-SnapshotDependencyTests-854076519 None] Acquiring lock "cinder-quobyte-090cb613-f21d-424a-bb92-74677ffe8007" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:24 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-752d6157-522d-4ee4-a636-f9e2446b230e tempest-SnapshotDependencyTests-854076519 None] Lock "cinder-quobyte-090cb613-f21d-424a-bb92-74677ffe8007" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:24 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8f5a92-1da2-4159-8cfe-d84e9d205222]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-752d6157-522d-4ee4-a636-f9e2446b230e tempest-SnapshotDependencyTests-854076519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-090cb613-f21d-424a-bb92-74677ffe8007 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:24 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:24 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a4a89e01-5de8-470e-92fc-539934eda08a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "cinder-9bb67679-3d15-4235-848c-f3e850ab12c9-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.info" returned: 0 in 0.480s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:24 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-090cb613-f21d-424a-bb92-74677ffe8007 Apr 16 23:08:24 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:24 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.info is being set with open permissions: ugo+rw Apr 16 23:08:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:24 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a4a89e01-5de8-470e-92fc-539934eda08a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "cinder-9bb67679-3d15-4235-848c-f3e850ab12c9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:24 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.info Apr 16 23:08:24 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:24 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a4a89e01-5de8-470e-92fc-539934eda08a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "cinder-quobyte-9bb67679-3d15-4235-848c-f3e850ab12c9" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:24 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a4a89e01-5de8-470e-92fc-539934eda08a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "cinder-quobyte-9bb67679-3d15-4235-848c-f3e850ab12c9" acquired by "delete_volume" :: waited 0.007s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:24 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c0ff87-be37-415d-9577-f5cb9a1e2424]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a4a89e01-5de8-470e-92fc-539934eda08a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9bb67679-3d15-4235-848c-f3e850ab12c9 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:24 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9bb67679-3d15-4235-848c-f3e850ab12c9 Apr 16 23:08:24 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:24 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-752d6157-522d-4ee4-a636-f9e2446b230e tempest-SnapshotDependencyTests-854076519 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-090cb613-f21d-424a-bb92-74677ffe8007" returned: 0 in 0.578s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-752d6157-522d-4ee4-a636-f9e2446b230e tempest-SnapshotDependencyTests-854076519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-090cb613-f21d-424a-bb92-74677ffe8007 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:24 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-090cb613-f21d-424a-bb92-74677ffe8007 Apr 16 23:08:24 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:24 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:24 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.info" returned: 0 in 0.521s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Acquiring lock "cinder-quobyte-ddab6cf5-3111-49af-8b7d-d2a4e6928bee" by "_copy_volume_from_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Lock "cinder-quobyte-ddab6cf5-3111-49af-8b7d-d2a4e6928bee" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] snapshot: 2be3ab90-7729-42fc-b24a-c2a69665078a, volume: ddab6cf5-3111-49af-8b7d-d2a4e6928bee, {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[20af0870-0ea7-435f-b184-113be2cd9658]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.2be3ab90-7729-42fc-b24a-c2a69665078a {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:25 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.2be3ab90-7729-42fc-b24a-c2a69665078a Apr 16 23:08:25 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:25 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a4a89e01-5de8-470e-92fc-539934eda08a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9bb67679-3d15-4235-848c-f3e850ab12c9" returned: 0 in 0.626s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a4a89e01-5de8-470e-92fc-539934eda08a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9bb67679-3d15-4235-848c-f3e850ab12c9 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:25 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9bb67679-3d15-4235-848c-f3e850ab12c9 Apr 16 23:08:25 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:25 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-752d6157-522d-4ee4-a636-f9e2446b230e tempest-SnapshotDependencyTests-854076519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-090cb613-f21d-424a-bb92-74677ffe8007" returned: 0 in 0.570s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-752d6157-522d-4ee4-a636-f9e2446b230e tempest-SnapshotDependencyTests-854076519 None] Lock "cinder-quobyte-090cb613-f21d-424a-bb92-74677ffe8007" released by "delete_volume" :: held 1.175s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:UPDATE=231,cinder:SELECT=161,cinder:DELETE=22,cinder:INSERT=55 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-752d6157-522d-4ee4-a636-f9e2446b230e tempest-SnapshotDependencyTests-854076519 None] Created reservations ['bcc89723-8dce-4b15-97bc-1d90735bb57d', '68db3eaf-d8b0-49a3-8d3e-1baa7de43eaa', '795909a5-2ff6-47b6-8e49-aec4ad673b21', 'af1b9603-9fe0-4e7c-ae69-79fa80a94eec'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:08:25 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.2be3ab90-7729-42fc-b24a-c2a69665078a" returned: 0 in 0.624s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77f55474-864c-4f43-9889-4d5c5bbaecdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] will copy from snapshot at /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Creating direct copy from snapshot {{(pid=81971) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-752d6157-522d-4ee4-a636-f9e2446b230e tempest-SnapshotDependencyTests-854076519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-752d6157-522d-4ee4-a636-f9e2446b230e tempest-SnapshotDependencyTests-854076519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-752d6157-522d-4ee4-a636-f9e2446b230e tempest-SnapshotDependencyTests-854076519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-752d6157-522d-4ee4-a636-f9e2446b230e tempest-SnapshotDependencyTests-854076519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-752d6157-522d-4ee4-a636-f9e2446b230e tempest-SnapshotDependencyTests-854076519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-752d6157-522d-4ee4-a636-f9e2446b230e tempest-SnapshotDependencyTests-854076519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a09137a-50f4-414b-9fd3-d5be5ece47eb]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:25 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:08:25 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:25 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a4a89e01-5de8-470e-92fc-539934eda08a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-9bb67679-3d15-4235-848c-f3e850ab12c9" returned: 0 in 0.549s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a4a89e01-5de8-470e-92fc-539934eda08a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "cinder-quobyte-9bb67679-3d15-4235-848c-f3e850ab12c9" released by "delete_volume" :: held 1.210s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-a4a89e01-5de8-470e-92fc-539934eda08a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Created reservations ['17ec2c24-6e3b-4f37-bd4d-411e36e0ff2d', '5b6f7745-24dd-4d0b-9d6e-cf454ff47a53', '5a191b82-49f0-4180-bff3-66c2673d9e41', '1229eff7-4a3f-4482-82fc-0a4398ba1471'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:08:25 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc Apr 16 23:08:25 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a4a89e01-5de8-470e-92fc-539934eda08a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a4a89e01-5de8-470e-92fc-539934eda08a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a4a89e01-5de8-470e-92fc-539934eda08a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-a4a89e01-5de8-470e-92fc-539934eda08a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-a4a89e01-5de8-470e-92fc-539934eda08a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:25 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a4a89e01-5de8-470e-92fc-539934eda08a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:25 devstack sudo[90706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:08:25 devstack sudo[90706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:26 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-752d6157-522d-4ee4-a636-f9e2446b230e tempest-SnapshotDependencyTests-854076519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.478s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:26 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-752d6157-522d-4ee4-a636-f9e2446b230e tempest-SnapshotDependencyTests-854076519 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:08:26 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-752d6157-522d-4ee4-a636-f9e2446b230e tempest-SnapshotDependencyTests-854076519 None] Deleted volume successfully. Apr 16 23:08:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-752d6157-522d-4ee4-a636-f9e2446b230e tempest-SnapshotDependencyTests-854076519 None] Lock "cinder-090cb613-f21d-424a-bb92-74677ffe8007-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:26 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc" returned: 0 in 0.652s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:26 devstack cinder-volume[81971]: DEBUG cinder.utils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Path /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ddab6cf5-3111-49af-8b7d-d2a4e6928bee not found in is_blk_device check {{(pid=81971) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 16 23:08:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ddab6cf5-3111-49af-8b7d-d2a4e6928bee {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:26 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ddab6cf5-3111-49af-8b7d-d2a4e6928bee Apr 16 23:08:26 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:26 devstack sudo[90706]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-a4a89e01-5de8-470e-92fc-539934eda08a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.537s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:26 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-a4a89e01-5de8-470e-92fc-539934eda08a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:08:26 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-a4a89e01-5de8-470e-92fc-539934eda08a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Deleted volume successfully. Apr 16 23:08:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-a4a89e01-5de8-470e-92fc-539934eda08a tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "cinder-9bb67679-3d15-4235-848c-f3e850ab12c9-delete_volume" released by "delete_volume" :: held 1.925s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-03009342-4521-4576-b162-9973498d845c tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "cinder-3e515b7f-470d-45e2-bb72-bbcdb2e4f50f-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-03009342-4521-4576-b162-9973498d845c tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "cinder-3e515b7f-470d-45e2-bb72-bbcdb2e4f50f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-03009342-4521-4576-b162-9973498d845c tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "cinder-quobyte-3e515b7f-470d-45e2-bb72-bbcdb2e4f50f" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:26 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-03009342-4521-4576-b162-9973498d845c tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "cinder-quobyte-3e515b7f-470d-45e2-bb72-bbcdb2e4f50f" acquired by "delete_volume" :: waited 0.016s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:26 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f671d5-962a-40f9-b501-de8ec4bd792b]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:26 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-03009342-4521-4576-b162-9973498d845c tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3e515b7f-470d-45e2-bb72-bbcdb2e4f50f {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:26 devstack sudo[90715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3e515b7f-470d-45e2-bb72-bbcdb2e4f50f Apr 16 23:08:26 devstack sudo[90715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:28 devstack sudo[90715]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-03009342-4521-4576-b162-9973498d845c tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3e515b7f-470d-45e2-bb72-bbcdb2e4f50f" returned: 0 in 1.305s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:28 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-03009342-4521-4576-b162-9973498d845c tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3e515b7f-470d-45e2-bb72-bbcdb2e4f50f {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:28 devstack sudo[90733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3e515b7f-470d-45e2-bb72-bbcdb2e4f50f Apr 16 23:08:28 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:29 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ddab6cf5-3111-49af-8b7d-d2a4e6928bee" returned: 0 in 3.380s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:29 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2743ae-8029-4209-ab90-30f5b429d26c]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:29 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-03009342-4521-4576-b162-9973498d845c tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3e515b7f-470d-45e2-bb72-bbcdb2e4f50f" returned: 0 in 1.686s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:29 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-03009342-4521-4576-b162-9973498d845c tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "cinder-quobyte-3e515b7f-470d-45e2-bb72-bbcdb2e4f50f" released by "delete_volume" :: held 3.039s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:29 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc Apr 16 23:08:29 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:29 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-03009342-4521-4576-b162-9973498d845c tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Created reservations ['830766f6-0602-4a2f-8c2c-b9ab73ac6c48', 'c24f4915-6ce3-4914-b3eb-4b6fa12f1c0c', '935c91db-6113-443e-a694-bada735cb7d6', '0fd45c83-4e7b-45fc-b988-a7cbe59e9bfd'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:08:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-03009342-4521-4576-b162-9973498d845c tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-03009342-4521-4576-b162-9973498d845c tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:29 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-03009342-4521-4576-b162-9973498d845c tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:29 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-03009342-4521-4576-b162-9973498d845c tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-03009342-4521-4576-b162-9973498d845c tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:29 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-03009342-4521-4576-b162-9973498d845c tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:29 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:08:29 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:30 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc" returned: 0 in 0.795s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:30 devstack cinder-volume[81971]: DEBUG cinder.image.image_utils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Image conversion details: src /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc, size 1024.00 MB, duration 3.38 sec, destination /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ddab6cf5-3111-49af-8b7d-d2a4e6928bee {{(pid=81971) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 16 23:08:30 devstack cinder-volume[81971]: INFO cinder.image.image_utils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Converted 1024.00 MB image at 302.75 MB/s Apr 16 23:08:30 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ddab6cf5-3111-49af-8b7d-d2a4e6928bee is being set with open permissions: ugo+rw Apr 16 23:08:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ddab6cf5-3111-49af-8b7d-d2a4e6928bee {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:30 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ddab6cf5-3111-49af-8b7d-d2a4e6928bee Apr 16 23:08:30 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:30 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:30 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-03009342-4521-4576-b162-9973498d845c tempest-CreateVolumesFromSourceVolumeTest-357674373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.663s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:30 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-03009342-4521-4576-b162-9973498d845c tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:08:30 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-03009342-4521-4576-b162-9973498d845c tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Deleted volume successfully. Apr 16 23:08:30 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-03009342-4521-4576-b162-9973498d845c tempest-CreateVolumesFromSourceVolumeTest-357674373 None] Lock "cinder-3e515b7f-470d-45e2-bb72-bbcdb2e4f50f-delete_volume" released by "delete_volume" :: held 3.939s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:31 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ddab6cf5-3111-49af-8b7d-d2a4e6928bee" returned: 0 in 0.628s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:31 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Lock "cinder-quobyte-ddab6cf5-3111-49af-8b7d-d2a4e6928bee" released by "_copy_volume_from_snapshot" :: held 6.156s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:31 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Acquiring lock "cinder-quobyte-2be3ab90-7729-42fc-b24a-c2a69665078a" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:31 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Lock "cinder-quobyte-2be3ab90-7729-42fc-b24a-c2a69665078a" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:31 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Deleting offline snapshot 2be3ab90-7729-42fc-b24a-c2a69665078a of volume 77f55474-864c-4f43-9889-4d5c5bbaecdc {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:08:31 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] snapshot_file for this snap is: volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.2be3ab90-7729-42fc-b24a-c2a69665078a {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:08:31 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd44de9-8345-413a-a041-146471ff5e3e]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.2be3ab90-7729-42fc-b24a-c2a69665078a {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:31 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.2be3ab90-7729-42fc-b24a-c2a69665078a Apr 16 23:08:31 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:31 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.2be3ab90-7729-42fc-b24a-c2a69665078a" returned: 0 in 0.766s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:31 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-77f55474-864c-4f43-9889-4d5c5bbaecdc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:08:31 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb9cc23-25ea-4a28-b222-c144fb5ebe79]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:31 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:32 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc Apr 16 23:08:32 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:32 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc" returned: 0 in 0.641s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:32 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.2be3ab90-7729-42fc-b24a-c2a69665078a {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:32 devstack sudo[90761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.2be3ab90-7729-42fc-b24a-c2a69665078a Apr 16 23:08:32 devstack sudo[90761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:33 devstack sudo[90761]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.2be3ab90-7729-42fc-b24a-c2a69665078a" returned: 0 in 0.665s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.2be3ab90-7729-42fc-b24a-c2a69665078a {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:33 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.2be3ab90-7729-42fc-b24a-c2a69665078a Apr 16 23:08:33 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:33 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc.2be3ab90-7729-42fc-b24a-c2a69665078a" returned: 0 in 0.563s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:33 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Lock "cinder-quobyte-2be3ab90-7729-42fc-b24a-c2a69665078a" released by "_delete_snapshot" :: held 2.703s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:33 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:SELECT=187,cinder:UPDATE=257,cinder:INSERT=58,cinder:DELETE=22 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 23:08:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.520s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.008s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-16T21:08:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1246291003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=675c0591-9714-474d-9e1b-8d6460ade4e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf9b20d3c0504449b9f606864d921a88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-16T21:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-16T21:08:23Z,use_quota=True,user_id='90af439d8a61425c99ad0573f8e2502b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6b019424-69f7-43b7-8c62-eb53ee3c86ff),volume_type_id=6b019424-69f7-43b7-8c62-eb53ee3c86ff)}" {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 16 23:08:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Creating volume 675c0591-9714-474d-9e1b-8d6460ade4e7 {{(pid=81971) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 16 23:08:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:33 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Selected osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e as target Quobyte volume. {{(pid=81971) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 16 23:08:33 devstack cinder-volume[81971]: INFO cinder.volume.drivers.remotefs [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] casted to osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e Apr 16 23:08:33 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7 1073741824 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91460cc-6e03-43eb-b140-3d90163e4e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddab6cf5-3111-49af-8b7d-d2a4e6928bee', 'volume_size': 1, 'source_volid': '77f55474-864c-4f43-9889-4d5c5bbaecdc', 'source_volstatus': 'available'}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:33 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d9f652d-e4aa-4b8f-bb38-7108342f1dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:33 devstack sudo[90770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7 1073741824 Apr 16 23:08:33 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:34 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Volume volume-ddab6cf5-3111-49af-8b7d-d2a4e6928bee (ddab6cf5-3111-49af-8b7d-d2a4e6928bee): created successfully Apr 16 23:08:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d9f652d-e4aa-4b8f-bb38-7108342f1dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:34 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Flow 'volume_create_manager' (6dcda20f-240e-4249-a29f-5c5b989ef6dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:08:34 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-07bd2cdd-738d-432d-afaf-27280710b8cd tempest-VolumeDependencyTests-786286978 None] Created volume successfully. Apr 16 23:08:34 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7 1073741824" returned: 0 in 0.748s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:34 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:34 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7 Apr 16 23:08:34 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:34 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c5f5e482-583c-49d6-9db6-39530a1bd8b2 tempest-VolumeDependencyTests-786286978 None] Acquiring lock "cinder-77f55474-864c-4f43-9889-4d5c5bbaecdc-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:34 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c5f5e482-583c-49d6-9db6-39530a1bd8b2 tempest-VolumeDependencyTests-786286978 None] Lock "cinder-77f55474-864c-4f43-9889-4d5c5bbaecdc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:34 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c5f5e482-583c-49d6-9db6-39530a1bd8b2 tempest-VolumeDependencyTests-786286978 None] Acquiring lock "cinder-quobyte-77f55474-864c-4f43-9889-4d5c5bbaecdc" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:35 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c5f5e482-583c-49d6-9db6-39530a1bd8b2 tempest-VolumeDependencyTests-786286978 None] Lock "cinder-quobyte-77f55474-864c-4f43-9889-4d5c5bbaecdc" acquired by "delete_volume" :: waited 0.017s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:35 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7eb748b-d245-47a9-8848-98cafb7bb964]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c5f5e482-583c-49d6-9db6-39530a1bd8b2 tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:35 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc Apr 16 23:08:35 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:35 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7" returned: 0 in 0.733s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:35 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'} {{(pid=81971) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 16 23:08:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41eb8c23-81c4-4916-9f0f-e53c4f9b78f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-675c0591-9714-474d-9e1b-8d6460ade4e7', 'volume_size': 1}' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4cb76a-fa22-4732-8639-e8b119f2b26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 16 23:08:35 devstack cinder-volume[81971]: INFO cinder.volume.flows.manager.create_volume [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Volume volume-675c0591-9714-474d-9e1b-8d6460ade4e7 (675c0591-9714-474d-9e1b-8d6460ade4e7): created successfully Apr 16 23:08:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4cb76a-fa22-4732-8639-e8b119f2b26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81971) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 16 23:08:35 devstack cinder-volume[81971]: DEBUG cinder.volume.manager [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Flow 'volume_create_manager' (fb448dab-055a-4df1-bc12-ff99eff72841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81971) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 16 23:08:35 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-aa630d14-da0b-4f61-881a-c15a2c94383e tempest-CinderUnicodeTest-325283011 None] Created volume successfully. Apr 16 23:08:35 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c5f5e482-583c-49d6-9db6-39530a1bd8b2 tempest-VolumeDependencyTests-786286978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc" returned: 0 in 0.743s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:35 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c5f5e482-583c-49d6-9db6-39530a1bd8b2 tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:35 devstack sudo[90783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc Apr 16 23:08:35 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-99edb6ba-d63f-4b0f-9da9-fb9cb6368b95 tempest-CinderUnicodeTest-325283011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-99edb6ba-d63f-4b0f-9da9-fb9cb6368b95 tempest-CinderUnicodeTest-325283011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-99edb6ba-d63f-4b0f-9da9-fb9cb6368b95 tempest-CinderUnicodeTest-325283011 None] Creating offline snapshot 93a927b2-a25b-43a4-b164-5629657d2843 of volume 675c0591-9714-474d-9e1b-8d6460ade4e7 {{(pid=81971) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 16 23:08:36 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc739e10-a207-458c-8d9e-3c245f4c1d42]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-99edb6ba-d63f-4b0f-9da9-fb9cb6368b95 tempest-CinderUnicodeTest-325283011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:36 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c5f5e482-583c-49d6-9db6-39530a1bd8b2 tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-77f55474-864c-4f43-9889-4d5c5bbaecdc" returned: 0 in 0.714s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:36 devstack sudo[90787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7 Apr 16 23:08:36 devstack sudo[90787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:36 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c5f5e482-583c-49d6-9db6-39530a1bd8b2 tempest-VolumeDependencyTests-786286978 None] Lock "cinder-quobyte-77f55474-864c-4f43-9889-4d5c5bbaecdc" released by "delete_volume" :: held 1.507s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:36 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-c5f5e482-583c-49d6-9db6-39530a1bd8b2 tempest-VolumeDependencyTests-786286978 None] Created reservations ['8b6f9ce0-5427-4e43-8cea-9c09afed3bae', '0c023ad8-6bae-4a8a-88c1-3822c9769d66', '7dd2015c-3f3b-4dbb-93da-31d18921215a', '86336a02-15fa-43c7-a43d-a46635e68b6e'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:08:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c5f5e482-583c-49d6-9db6-39530a1bd8b2 tempest-VolumeDependencyTests-786286978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c5f5e482-583c-49d6-9db6-39530a1bd8b2 tempest-VolumeDependencyTests-786286978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c5f5e482-583c-49d6-9db6-39530a1bd8b2 tempest-VolumeDependencyTests-786286978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:36 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-c5f5e482-583c-49d6-9db6-39530a1bd8b2 tempest-VolumeDependencyTests-786286978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-c5f5e482-583c-49d6-9db6-39530a1bd8b2 tempest-VolumeDependencyTests-786286978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:36 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c5f5e482-583c-49d6-9db6-39530a1bd8b2 tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:36 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:08:36 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:37 devstack sudo[90787]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-99edb6ba-d63f-4b0f-9da9-fb9cb6368b95 tempest-CinderUnicodeTest-325283011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7" returned: 0 in 0.689s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-99edb6ba-d63f-4b0f-9da9-fb9cb6368b95 tempest-CinderUnicodeTest-325283011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.93a927b2-a25b-43a4-b164-5629657d2843 1G {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:37 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.93a927b2-a25b-43a4-b164-5629657d2843 1G Apr 16 23:08:37 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:37 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-81ef760b-5da9-4aee-bf58-a046f6aa8af6 tempest-VolumeDependencyTests-786286978 None] Acquiring lock "cinder-ddab6cf5-3111-49af-8b7d-d2a4e6928bee-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:37 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-81ef760b-5da9-4aee-bf58-a046f6aa8af6 tempest-VolumeDependencyTests-786286978 None] Lock "cinder-ddab6cf5-3111-49af-8b7d-d2a4e6928bee-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:37 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-c5f5e482-583c-49d6-9db6-39530a1bd8b2 tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.621s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:37 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-c5f5e482-583c-49d6-9db6-39530a1bd8b2 tempest-VolumeDependencyTests-786286978 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:08:37 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-c5f5e482-583c-49d6-9db6-39530a1bd8b2 tempest-VolumeDependencyTests-786286978 None] Deleted volume successfully. Apr 16 23:08:37 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-c5f5e482-583c-49d6-9db6-39530a1bd8b2 tempest-VolumeDependencyTests-786286978 None] Lock "cinder-77f55474-864c-4f43-9889-4d5c5bbaecdc-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:37 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-81ef760b-5da9-4aee-bf58-a046f6aa8af6 tempest-VolumeDependencyTests-786286978 None] Acquiring lock "cinder-quobyte-ddab6cf5-3111-49af-8b7d-d2a4e6928bee" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:37 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-81ef760b-5da9-4aee-bf58-a046f6aa8af6 tempest-VolumeDependencyTests-786286978 None] Lock "cinder-quobyte-ddab6cf5-3111-49af-8b7d-d2a4e6928bee" acquired by "delete_volume" :: waited 0.012s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:37 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdae413-d790-431c-98ef-c61116e80444]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-81ef760b-5da9-4aee-bf58-a046f6aa8af6 tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ddab6cf5-3111-49af-8b7d-d2a4e6928bee {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:37 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ddab6cf5-3111-49af-8b7d-d2a4e6928bee Apr 16 23:08:37 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:37 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-99edb6ba-d63f-4b0f-9da9-fb9cb6368b95 tempest-CinderUnicodeTest-325283011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.93a927b2-a25b-43a4-b164-5629657d2843 1G" returned: 0 in 0.727s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:37 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-99edb6ba-d63f-4b0f-9da9-fb9cb6368b95 tempest-CinderUnicodeTest-325283011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-675c0591-9714-474d-9e1b-8d6460ade4e7 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.93a927b2-a25b-43a4-b164-5629657d2843 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:37 devstack sudo[90802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-675c0591-9714-474d-9e1b-8d6460ade4e7 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.93a927b2-a25b-43a4-b164-5629657d2843 Apr 16 23:08:37 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:38 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-81ef760b-5da9-4aee-bf58-a046f6aa8af6 tempest-VolumeDependencyTests-786286978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ddab6cf5-3111-49af-8b7d-d2a4e6928bee" returned: 0 in 0.655s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-81ef760b-5da9-4aee-bf58-a046f6aa8af6 tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ddab6cf5-3111-49af-8b7d-d2a4e6928bee {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:38 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ddab6cf5-3111-49af-8b7d-d2a4e6928bee Apr 16 23:08:38 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:38 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-99edb6ba-d63f-4b0f-9da9-fb9cb6368b95 tempest-CinderUnicodeTest-325283011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-675c0591-9714-474d-9e1b-8d6460ade4e7 -F qcow2 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.93a927b2-a25b-43a4-b164-5629657d2843" returned: 0 in 0.583s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:38 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-99edb6ba-d63f-4b0f-9da9-fb9cb6368b95 tempest-CinderUnicodeTest-325283011 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.93a927b2-a25b-43a4-b164-5629657d2843 is being set with open permissions: ugo+rw Apr 16 23:08:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-99edb6ba-d63f-4b0f-9da9-fb9cb6368b95 tempest-CinderUnicodeTest-325283011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.93a927b2-a25b-43a4-b164-5629657d2843 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:38 devstack sudo[90812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.93a927b2-a25b-43a4-b164-5629657d2843 Apr 16 23:08:38 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:38 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-81ef760b-5da9-4aee-bf58-a046f6aa8af6 tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-ddab6cf5-3111-49af-8b7d-d2a4e6928bee" returned: 0 in 0.586s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:38 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-81ef760b-5da9-4aee-bf58-a046f6aa8af6 tempest-VolumeDependencyTests-786286978 None] Lock "cinder-quobyte-ddab6cf5-3111-49af-8b7d-d2a4e6928bee" released by "delete_volume" :: held 1.273s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:38 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-81ef760b-5da9-4aee-bf58-a046f6aa8af6 tempest-VolumeDependencyTests-786286978 None] Created reservations ['97256806-3aa0-4f90-b1d3-e014792ec322', '2c845daf-bdb3-4d20-8c4d-9c1d28e3b40f', '58ef1b42-3d88-4969-8ede-d2ca8820fd7f', '41a0d040-4641-48b4-8c03-e4a14475add7'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:08:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-81ef760b-5da9-4aee-bf58-a046f6aa8af6 tempest-VolumeDependencyTests-786286978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-81ef760b-5da9-4aee-bf58-a046f6aa8af6 tempest-VolumeDependencyTests-786286978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:38 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-81ef760b-5da9-4aee-bf58-a046f6aa8af6 tempest-VolumeDependencyTests-786286978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:38 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-81ef760b-5da9-4aee-bf58-a046f6aa8af6 tempest-VolumeDependencyTests-786286978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-81ef760b-5da9-4aee-bf58-a046f6aa8af6 tempest-VolumeDependencyTests-786286978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:38 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-81ef760b-5da9-4aee-bf58-a046f6aa8af6 tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:38 devstack sudo[90815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:08:38 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:39 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-99edb6ba-d63f-4b0f-9da9-fb9cb6368b95 tempest-CinderUnicodeTest-325283011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.93a927b2-a25b-43a4-b164-5629657d2843" returned: 0 in 0.596s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-99edb6ba-d63f-4b0f-9da9-fb9cb6368b95 tempest-CinderUnicodeTest-325283011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:39 devstack sudo[90818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.info Apr 16 23:08:39 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:39 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-81ef760b-5da9-4aee-bf58-a046f6aa8af6 tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.474s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:39 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-81ef760b-5da9-4aee-bf58-a046f6aa8af6 tempest-VolumeDependencyTests-786286978 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:08:39 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-81ef760b-5da9-4aee-bf58-a046f6aa8af6 tempest-VolumeDependencyTests-786286978 None] Deleted volume successfully. Apr 16 23:08:39 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-81ef760b-5da9-4aee-bf58-a046f6aa8af6 tempest-VolumeDependencyTests-786286978 None] Lock "cinder-ddab6cf5-3111-49af-8b7d-d2a4e6928bee-delete_volume" released by "delete_volume" :: held 1.943s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:39 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ef53497a-5572-482c-8b24-123c9694cf97 tempest-VolumeDependencyTests-786286978 None] Acquiring lock "cinder-3fe6879b-82a8-4eb2-a0bf-5cf747c62195-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:39 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ef53497a-5572-482c-8b24-123c9694cf97 tempest-VolumeDependencyTests-786286978 None] Lock "cinder-3fe6879b-82a8-4eb2-a0bf-5cf747c62195-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:39 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ef53497a-5572-482c-8b24-123c9694cf97 tempest-VolumeDependencyTests-786286978 None] Acquiring lock "cinder-quobyte-3fe6879b-82a8-4eb2-a0bf-5cf747c62195" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:39 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ef53497a-5572-482c-8b24-123c9694cf97 tempest-VolumeDependencyTests-786286978 None] Lock "cinder-quobyte-3fe6879b-82a8-4eb2-a0bf-5cf747c62195" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:39 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe47fbaf-088f-4305-8b79-a3a7ba97d6cf]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ef53497a-5572-482c-8b24-123c9694cf97 tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3fe6879b-82a8-4eb2-a0bf-5cf747c62195 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:39 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-99edb6ba-d63f-4b0f-9da9-fb9cb6368b95 tempest-CinderUnicodeTest-325283011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.info" returned: 0 in 0.587s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:39 devstack cinder-volume[81971]: WARNING cinder.volume.drivers.remotefs [None req-99edb6ba-d63f-4b0f-9da9-fb9cb6368b95 tempest-CinderUnicodeTest-325283011 None] /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.info is being set with open permissions: ugo+rw Apr 16 23:08:39 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-99edb6ba-d63f-4b0f-9da9-fb9cb6368b95 tempest-CinderUnicodeTest-325283011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.info {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:39 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.info Apr 16 23:08:39 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:39 devstack sudo[90822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3fe6879b-82a8-4eb2-a0bf-5cf747c62195 Apr 16 23:08:39 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:40 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-99edb6ba-d63f-4b0f-9da9-fb9cb6368b95 tempest-CinderUnicodeTest-325283011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.info" returned: 0 in 0.477s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-99edb6ba-d63f-4b0f-9da9-fb9cb6368b95 tempest-CinderUnicodeTest-325283011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.739s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:40 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-99edb6ba-d63f-4b0f-9da9-fb9cb6368b95 tempest-CinderUnicodeTest-325283011 None] Create snapshot completed successfully Apr 16 23:08:40 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ef53497a-5572-482c-8b24-123c9694cf97 tempest-VolumeDependencyTests-786286978 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3fe6879b-82a8-4eb2-a0bf-5cf747c62195" returned: 0 in 0.615s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ef53497a-5572-482c-8b24-123c9694cf97 tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3fe6879b-82a8-4eb2-a0bf-5cf747c62195 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:40 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3fe6879b-82a8-4eb2-a0bf-5cf747c62195 Apr 16 23:08:40 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:40 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6dc15e7b-b416-476e-b65c-d707ee0b9c2c tempest-CinderUnicodeTest-325283011 None] Acquiring lock "cinder-93a927b2-a25b-43a4-b164-5629657d2843-delete_snapshot" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:40 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6dc15e7b-b416-476e-b65c-d707ee0b9c2c tempest-CinderUnicodeTest-325283011 None] Lock "cinder-93a927b2-a25b-43a4-b164-5629657d2843-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:40 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6dc15e7b-b416-476e-b65c-d707ee0b9c2c tempest-CinderUnicodeTest-325283011 None] Acquiring lock "cinder-quobyte-675c0591-9714-474d-9e1b-8d6460ade4e7" by "delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:40 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6dc15e7b-b416-476e-b65c-d707ee0b9c2c tempest-CinderUnicodeTest-325283011 None] Lock "cinder-quobyte-675c0591-9714-474d-9e1b-8d6460ade4e7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:40 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6dc15e7b-b416-476e-b65c-d707ee0b9c2c tempest-CinderUnicodeTest-325283011 None] Acquiring lock "cinder-quobyte-93a927b2-a25b-43a4-b164-5629657d2843" by "_delete_snapshot" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:40 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6dc15e7b-b416-476e-b65c-d707ee0b9c2c tempest-CinderUnicodeTest-325283011 None] Lock "cinder-quobyte-93a927b2-a25b-43a4-b164-5629657d2843" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-6dc15e7b-b416-476e-b65c-d707ee0b9c2c tempest-CinderUnicodeTest-325283011 None] Deleting offline snapshot 93a927b2-a25b-43a4-b164-5629657d2843 of volume 675c0591-9714-474d-9e1b-8d6460ade4e7 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 16 23:08:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-6dc15e7b-b416-476e-b65c-d707ee0b9c2c tempest-CinderUnicodeTest-325283011 None] snapshot_file for this snap is: volume-675c0591-9714-474d-9e1b-8d6460ade4e7.93a927b2-a25b-43a4-b164-5629657d2843 {{(pid=81971) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 16 23:08:40 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8fd7c1-60a3-4edb-92d7-4c24f5b67d1a]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6dc15e7b-b416-476e-b65c-d707ee0b9c2c tempest-CinderUnicodeTest-325283011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.93a927b2-a25b-43a4-b164-5629657d2843 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:40 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ef53497a-5572-482c-8b24-123c9694cf97 tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-3fe6879b-82a8-4eb2-a0bf-5cf747c62195" returned: 0 in 0.485s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:40 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ef53497a-5572-482c-8b24-123c9694cf97 tempest-VolumeDependencyTests-786286978 None] Lock "cinder-quobyte-3fe6879b-82a8-4eb2-a0bf-5cf747c62195" released by "delete_volume" :: held 1.139s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:40 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-ef53497a-5572-482c-8b24-123c9694cf97 tempest-VolumeDependencyTests-786286978 None] Created reservations ['1c5559ad-45c4-4ced-9a91-e8a200a0bd34', 'd441a480-cb45-4b93-826e-1ad3103b21df', '262c84ac-b764-4d7e-91b9-2856d64b51e6', 'ff8d2fae-f538-461b-83c4-5af02586205e'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:08:40 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.93a927b2-a25b-43a4-b164-5629657d2843 Apr 16 23:08:40 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ef53497a-5572-482c-8b24-123c9694cf97 tempest-VolumeDependencyTests-786286978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ef53497a-5572-482c-8b24-123c9694cf97 tempest-VolumeDependencyTests-786286978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ef53497a-5572-482c-8b24-123c9694cf97 tempest-VolumeDependencyTests-786286978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:40 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ef53497a-5572-482c-8b24-123c9694cf97 tempest-VolumeDependencyTests-786286978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ef53497a-5572-482c-8b24-123c9694cf97 tempest-VolumeDependencyTests-786286978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:40 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ef53497a-5572-482c-8b24-123c9694cf97 tempest-VolumeDependencyTests-786286978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:40 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:08:40 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:41 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6dc15e7b-b416-476e-b65c-d707ee0b9c2c tempest-CinderUnicodeTest-325283011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.93a927b2-a25b-43a4-b164-5629657d2843" returned: 0 in 0.503s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:41 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.remotefs [None req-6dc15e7b-b416-476e-b65c-d707ee0b9c2c tempest-CinderUnicodeTest-325283011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-675c0591-9714-474d-9e1b-8d6460ade4e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81971) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 16 23:08:41 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b161e9-a3ad-4064-af7a-7043811337d5]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6dc15e7b-b416-476e-b65c-d707ee0b9c2c tempest-CinderUnicodeTest-325283011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:41 devstack sudo[90840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7 Apr 16 23:08:41 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:41 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ef53497a-5572-482c-8b24-123c9694cf97 tempest-VolumeDependencyTests-786286978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.499s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:41 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-ef53497a-5572-482c-8b24-123c9694cf97 tempest-VolumeDependencyTests-786286978 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:08:41 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-ef53497a-5572-482c-8b24-123c9694cf97 tempest-VolumeDependencyTests-786286978 None] Deleted volume successfully. Apr 16 23:08:41 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ef53497a-5572-482c-8b24-123c9694cf97 tempest-VolumeDependencyTests-786286978 None] Lock "cinder-3fe6879b-82a8-4eb2-a0bf-5cf747c62195-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:41 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6dc15e7b-b416-476e-b65c-d707ee0b9c2c tempest-CinderUnicodeTest-325283011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7" returned: 0 in 0.616s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:41 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6dc15e7b-b416-476e-b65c-d707ee0b9c2c tempest-CinderUnicodeTest-325283011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.93a927b2-a25b-43a4-b164-5629657d2843 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:41 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.93a927b2-a25b-43a4-b164-5629657d2843 Apr 16 23:08:41 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:42 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6dc15e7b-b416-476e-b65c-d707ee0b9c2c tempest-CinderUnicodeTest-325283011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.93a927b2-a25b-43a4-b164-5629657d2843" returned: 0 in 0.672s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:42 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6dc15e7b-b416-476e-b65c-d707ee0b9c2c tempest-CinderUnicodeTest-325283011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.93a927b2-a25b-43a4-b164-5629657d2843 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:42 devstack sudo[90852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.93a927b2-a25b-43a4-b164-5629657d2843 Apr 16 23:08:42 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:43 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-6dc15e7b-b416-476e-b65c-d707ee0b9c2c tempest-CinderUnicodeTest-325283011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7.93a927b2-a25b-43a4-b164-5629657d2843" returned: 0 in 0.831s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6dc15e7b-b416-476e-b65c-d707ee0b9c2c tempest-CinderUnicodeTest-325283011 None] Lock "cinder-quobyte-93a927b2-a25b-43a4-b164-5629657d2843" released by "_delete_snapshot" :: held 2.710s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6dc15e7b-b416-476e-b65c-d707ee0b9c2c tempest-CinderUnicodeTest-325283011 None] Lock "cinder-quobyte-675c0591-9714-474d-9e1b-8d6460ade4e7" released by "delete_snapshot" :: held 2.743s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:43 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-6dc15e7b-b416-476e-b65c-d707ee0b9c2c tempest-CinderUnicodeTest-325283011 None] Created reservations ['e048249a-df82-4307-95e3-89616718d58c', '7b0fc89c-3432-47a8-bddf-e603e632f9c3', 'b5cfbcce-eefd-4562-8f9b-8a3b66a5f2e1', 'cd74a936-d566-4f76-b776-7ca4ffd8b5dc'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:08:43 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-6dc15e7b-b416-476e-b65c-d707ee0b9c2c tempest-CinderUnicodeTest-325283011 None] Delete snapshot completed successfully. Apr 16 23:08:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-6dc15e7b-b416-476e-b65c-d707ee0b9c2c tempest-CinderUnicodeTest-325283011 None] Lock "cinder-93a927b2-a25b-43a4-b164-5629657d2843-delete_snapshot" released by "delete_snapshot" :: held 2.897s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b80c4048-5e05-4985-9b29-abe9fd27c5b2 tempest-CinderUnicodeTest-325283011 None] Acquiring lock "cinder-675c0591-9714-474d-9e1b-8d6460ade4e7-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b80c4048-5e05-4985-9b29-abe9fd27c5b2 tempest-CinderUnicodeTest-325283011 None] Lock "cinder-675c0591-9714-474d-9e1b-8d6460ade4e7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b80c4048-5e05-4985-9b29-abe9fd27c5b2 tempest-CinderUnicodeTest-325283011 None] Acquiring lock "cinder-quobyte-675c0591-9714-474d-9e1b-8d6460ade4e7" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:43 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b80c4048-5e05-4985-9b29-abe9fd27c5b2 tempest-CinderUnicodeTest-325283011 None] Lock "cinder-quobyte-675c0591-9714-474d-9e1b-8d6460ade4e7" acquired by "delete_volume" :: waited 0.015s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:43 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[024f48d4-4a7d-484f-adc9-d2039111847d]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:43 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b80c4048-5e05-4985-9b29-abe9fd27c5b2 tempest-CinderUnicodeTest-325283011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:43 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7 Apr 16 23:08:43 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:44 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b80c4048-5e05-4985-9b29-abe9fd27c5b2 tempest-CinderUnicodeTest-325283011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7" returned: 0 in 0.598s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b80c4048-5e05-4985-9b29-abe9fd27c5b2 tempest-CinderUnicodeTest-325283011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:44 devstack sudo[90860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7 Apr 16 23:08:44 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:44 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:44 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b80c4048-5e05-4985-9b29-abe9fd27c5b2 tempest-CinderUnicodeTest-325283011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-675c0591-9714-474d-9e1b-8d6460ade4e7" returned: 0 in 0.510s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:44 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b80c4048-5e05-4985-9b29-abe9fd27c5b2 tempest-CinderUnicodeTest-325283011 None] Lock "cinder-quobyte-675c0591-9714-474d-9e1b-8d6460ade4e7" released by "delete_volume" :: held 1.154s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:45 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-b80c4048-5e05-4985-9b29-abe9fd27c5b2 tempest-CinderUnicodeTest-325283011 None] Created reservations ['f04ac70f-40bd-4f28-b32c-634c2e8e9444', '97d840a0-c664-425b-b82e-7fdad0274e1d', 'af81e0b1-f722-45e6-a0b3-02f14bf223fa', '752fac79-91b5-4342-a6a6-15d79f3e01f3'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:08:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b80c4048-5e05-4985-9b29-abe9fd27c5b2 tempest-CinderUnicodeTest-325283011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b80c4048-5e05-4985-9b29-abe9fd27c5b2 tempest-CinderUnicodeTest-325283011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:45 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b80c4048-5e05-4985-9b29-abe9fd27c5b2 tempest-CinderUnicodeTest-325283011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:45 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-b80c4048-5e05-4985-9b29-abe9fd27c5b2 tempest-CinderUnicodeTest-325283011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-b80c4048-5e05-4985-9b29-abe9fd27c5b2 tempest-CinderUnicodeTest-325283011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b80c4048-5e05-4985-9b29-abe9fd27c5b2 tempest-CinderUnicodeTest-325283011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:45 devstack sudo[90864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:08:45 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:45 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:45 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-b80c4048-5e05-4985-9b29-abe9fd27c5b2 tempest-CinderUnicodeTest-325283011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.500s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:45 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-b80c4048-5e05-4985-9b29-abe9fd27c5b2 tempest-CinderUnicodeTest-325283011 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:08:45 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-b80c4048-5e05-4985-9b29-abe9fd27c5b2 tempest-CinderUnicodeTest-325283011 None] Deleted volume successfully. Apr 16 23:08:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-b80c4048-5e05-4985-9b29-abe9fd27c5b2 tempest-CinderUnicodeTest-325283011 None] Lock "cinder-675c0591-9714-474d-9e1b-8d6460ade4e7-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ae3fae0d-24f4-4d34-a916-8fbe198dcf21 tempest-CinderUnicodeTest-325283011 None] Acquiring lock "cinder-40c5cee7-f3b2-47dd-8be0-a9e31cd505d2-delete_volume" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:45 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ae3fae0d-24f4-4d34-a916-8fbe198dcf21 tempest-CinderUnicodeTest-325283011 None] Lock "cinder-40c5cee7-f3b2-47dd-8be0-a9e31cd505d2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ae3fae0d-24f4-4d34-a916-8fbe198dcf21 tempest-CinderUnicodeTest-325283011 None] Acquiring lock "cinder-quobyte-40c5cee7-f3b2-47dd-8be0-a9e31cd505d2" by "delete_volume" {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 16 23:08:46 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ae3fae0d-24f4-4d34-a916-8fbe198dcf21 tempest-CinderUnicodeTest-325283011 None] Lock "cinder-quobyte-40c5cee7-f3b2-47dd-8be0-a9e31cd505d2" acquired by "delete_volume" :: waited 0.008s {{(pid=81971) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 16 23:08:46 devstack cinder-volume[81971]: DEBUG oslo.privsep.daemon [-] privsep: reply[b944277b-b814-4038-bfad-4c4b91690cf1]: (4, 'qcow2') {{(pid=82922) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 16 23:08:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ae3fae0d-24f4-4d34-a916-8fbe198dcf21 tempest-CinderUnicodeTest-325283011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-40c5cee7-f3b2-47dd-8be0-a9e31cd505d2 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:46 devstack sudo[90867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-40c5cee7-f3b2-47dd-8be0-a9e31cd505d2 Apr 16 23:08:46 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:46 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ae3fae0d-24f4-4d34-a916-8fbe198dcf21 tempest-CinderUnicodeTest-325283011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-40c5cee7-f3b2-47dd-8be0-a9e31cd505d2" returned: 0 in 0.625s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:46 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ae3fae0d-24f4-4d34-a916-8fbe198dcf21 tempest-CinderUnicodeTest-325283011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-40c5cee7-f3b2-47dd-8be0-a9e31cd505d2 {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:46 devstack sudo[90872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-40c5cee7-f3b2-47dd-8be0-a9e31cd505d2 Apr 16 23:08:46 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:47 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ae3fae0d-24f4-4d34-a916-8fbe198dcf21 tempest-CinderUnicodeTest-325283011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e/volume-40c5cee7-f3b2-47dd-8be0-a9e31cd505d2" returned: 0 in 0.521s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:47 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ae3fae0d-24f4-4d34-a916-8fbe198dcf21 tempest-CinderUnicodeTest-325283011 None] Lock "cinder-quobyte-40c5cee7-f3b2-47dd-8be0-a9e31cd505d2" released by "delete_volume" :: held 1.178s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:47 devstack cinder-volume[81971]: DEBUG cinder.quota [None req-ae3fae0d-24f4-4d34-a916-8fbe198dcf21 tempest-CinderUnicodeTest-325283011 None] Created reservations ['cd16249e-1f3b-4231-bfa1-06e2f24261e4', '11bfa6fe-46ec-4b6b-89d6-8e7fa78a39e1', '4e98afb2-01fe-4c84-8d63-ab0b45940bfa', '995ed148-2e59-4490-a598-3302561879fd'] {{(pid=81971) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 16 23:08:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ae3fae0d-24f4-4d34-a916-8fbe198dcf21 tempest-CinderUnicodeTest-325283011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 16 23:08:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ae3fae0d-24f4-4d34-a916-8fbe198dcf21 tempest-CinderUnicodeTest-325283011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 16 23:08:47 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ae3fae0d-24f4-4d34-a916-8fbe198dcf21 tempest-CinderUnicodeTest-325283011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e': None} {{(pid=81971) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 16 23:08:47 devstack cinder-volume[81971]: DEBUG cinder.volume.drivers.quobyte [None req-ae3fae0d-24f4-4d34-a916-8fbe198dcf21 tempest-CinderUnicodeTest-325283011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-122ab216-c302-4db6-ba76-effec51b759e'] {{(pid=81971) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 16 23:08:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.lockutils [None req-ae3fae0d-24f4-4d34-a916-8fbe198dcf21 tempest-CinderUnicodeTest-325283011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81971) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 16 23:08:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ae3fae0d-24f4-4d34-a916-8fbe198dcf21 tempest-CinderUnicodeTest-325283011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 16 23:08:47 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e Apr 16 23:08:47 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 16 23:08:47 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Apr 16 23:08:47 devstack cinder-volume[81971]: DEBUG oslo_concurrency.processutils [None req-ae3fae0d-24f4-4d34-a916-8fbe198dcf21 tempest-CinderUnicodeTest-325283011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/aafae4d2bf1858a0c9a417c17f37eb0e" returned: 0 in 0.538s {{(pid=81971) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 16 23:08:47 devstack cinder-volume[81971]: DEBUG cinder.manager [None req-ae3fae0d-24f4-4d34-a916-8fbe198dcf21 tempest-CinderUnicodeTest-325283011 None] Notifying Schedulers of capabilities ... {{(pid=81971) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 16 23:08:47 devstack cinder-volume[81971]: INFO cinder.volume.manager [None req-ae3fae0d-24f4-4d34-a916-8fbe198dcf21 tempest-CinderUnicodeTest-325283011 None] Deleted volume successfully. Apr 16 23:08:47 devstack cinder-volume[81971]: DEBUG cinder.coordination [None req-ae3fae0d-24f4-4d34-a916-8fbe198dcf21 tempest-CinderUnicodeTest-325283011 None] Lock "cinder-40c5cee7-f3b2-47dd-8be0-a9e31cd505d2-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=81971) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 16 23:08:57 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:SELECT=44,cinder:INSERT=21,cinder:UPDATE=62,cinder:DELETE=4 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 16 23:08:57 devstack cinder-volume[81971]: DEBUG dbcounter [-] [81971] Writing DB stats cinder:UPDATE=55,cinder:DELETE=6,cinder:SELECT=37,cinder:INSERT=11 {{(pid=81971) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}